Note: This is test shard 1 of 8.
[==========] Running 2 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 1 test from MaintenanceModeRF3ITest
[ RUN ] MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate
2026-04-29T19:54:25Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-04-29T19:54:25Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260429 19:54:25.823061 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.32.126:41131
--webserver_interface=127.10.32.126
--webserver_port=0
--builtin_ntp_servers=127.10.32.84:40097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.32.126:41131 with env {}
W20260429 19:54:26.158555 10377 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:54:26.158906 10377 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:54:26.159003 10377 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:54:26.167778 10377 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260429 19:54:26.167892 10377 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:54:26.167945 10377 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260429 19:54:26.167984 10377 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260429 19:54:26.178854 10377 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.32.126:41131
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.32.126:41131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.32.126
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:54:26.180507 10377 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:54:26.182330 10377 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260429 19:54:26.190649 10383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:54:26.190685 10382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:54:26.191138 10385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:54:26.192076 10377 server_base.cc:1061] running on GCE node
I20260429 19:54:26.192879 10377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 19:54:26.194571 10377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:54:26.195830 10377 hybrid_clock.cc:648] HybridClock initialized: now 1777492466195767 us; error 60 us; skew 500 ppm
I20260429 19:54:26.196213 10377 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:54:26.198732 10377 webserver.cc:492] Webserver started at http://127.10.32.126:38515/ using document root <none> and password file <none>
I20260429 19:54:26.199524 10377 fs_manager.cc:362] Metadata directory not provided
I20260429 19:54:26.199649 10377 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 19:54:26.200016 10377 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260429 19:54:26.202631 10377 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/data/instance:
uuid: "98be11f3a0ee40a698e46efd973288eb"
format_stamp: "Formatted at 2026-04-29 19:54:26 on dist-test-slave-hwg5"
I20260429 19:54:26.203500 10377 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/wal/instance:
uuid: "98be11f3a0ee40a698e46efd973288eb"
format_stamp: "Formatted at 2026-04-29 19:54:26 on dist-test-slave-hwg5"
I20260429 19:54:26.209534 10377 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260429 19:54:26.213397 10391 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:54:26.214998 10377 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260429 19:54:26.215189 10377 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/wal
uuid: "98be11f3a0ee40a698e46efd973288eb"
format_stamp: "Formatted at 2026-04-29 19:54:26 on dist-test-slave-hwg5"
I20260429 19:54:26.215399 10377 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 19:54:26.237437 10377 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:54:26.238462 10377 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:54:26.238761 10377 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:54:26.259215 10442 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.126:41131 every 8 connection(s)
I20260429 19:54:26.259246 10377 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.126:41131
I20260429 19:54:26.261416 10377 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/data/info.pb
I20260429 19:54:26.266323 10443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:54:26.272367 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 10377
I20260429 19:54:26.272632 10369 external_mini_cluster.cc:1442] Reading /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/wal/instance
I20260429 19:54:26.276182 10443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb: Bootstrap starting.
I20260429 19:54:26.280154 10443 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb: Neither blocks nor log segments found. Creating new log.
I20260429 19:54:26.281863 10443 log.cc:826] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb: Log is configured to *not* fsync() on all Append() calls
I20260429 19:54:26.284745 10443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb: No bootstrap required, opened a new log
I20260429 19:54:26.291093 10443 raft_consensus.cc:359] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98be11f3a0ee40a698e46efd973288eb" member_type: VOTER last_known_addr { host: "127.10.32.126" port: 41131 } }
I20260429 19:54:26.291519 10443 raft_consensus.cc:385] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:54:26.291628 10443 raft_consensus.cc:740] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98be11f3a0ee40a698e46efd973288eb, State: Initialized, Role: FOLLOWER
I20260429 19:54:26.292335 10443 consensus_queue.cc:260] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98be11f3a0ee40a698e46efd973288eb" member_type: VOTER last_known_addr { host: "127.10.32.126" port: 41131 } }
I20260429 19:54:26.292768 10443 raft_consensus.cc:399] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260429 19:54:26.292914 10443 raft_consensus.cc:493] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260429 19:54:26.293067 10443 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [term 0 FOLLOWER]: Advancing to term 1
I20260429 19:54:26.295249 10443 raft_consensus.cc:515] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98be11f3a0ee40a698e46efd973288eb" member_type: VOTER last_known_addr { host: "127.10.32.126" port: 41131 } }
I20260429 19:54:26.295853 10443 leader_election.cc:304] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 98be11f3a0ee40a698e46efd973288eb; no voters:
I20260429 19:54:26.296511 10443 leader_election.cc:290] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260429 19:54:26.296640 10448 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [term 1 FOLLOWER]: Leader election won for term 1
I20260429 19:54:26.297300 10448 raft_consensus.cc:697] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [term 1 LEADER]: Becoming Leader. State: Replica: 98be11f3a0ee40a698e46efd973288eb, State: Running, Role: LEADER
I20260429 19:54:26.297861 10448 consensus_queue.cc:237] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98be11f3a0ee40a698e46efd973288eb" member_type: VOTER last_known_addr { host: "127.10.32.126" port: 41131 } }
I20260429 19:54:26.298679 10443 sys_catalog.cc:565] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [sys.catalog]: configured and running, proceeding with master startup.
I20260429 19:54:26.300625 10450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 98be11f3a0ee40a698e46efd973288eb. Latest consensus state: current_term: 1 leader_uuid: "98be11f3a0ee40a698e46efd973288eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98be11f3a0ee40a698e46efd973288eb" member_type: VOTER last_known_addr { host: "127.10.32.126" port: 41131 } } }
I20260429 19:54:26.301088 10450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [sys.catalog]: This master's current role is: LEADER
I20260429 19:54:26.302183 10454 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260429 19:54:26.304112 10449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "98be11f3a0ee40a698e46efd973288eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98be11f3a0ee40a698e46efd973288eb" member_type: VOTER last_known_addr { host: "127.10.32.126" port: 41131 } } }
I20260429 19:54:26.305284 10449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [sys.catalog]: This master's current role is: LEADER
I20260429 19:54:26.313527 10454 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260429 19:54:26.325121 10454 catalog_manager.cc:1357] Generated new cluster ID: 0a135f9448584901bc187853f1f977b8
I20260429 19:54:26.325238 10454 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260429 19:54:26.359490 10454 catalog_manager.cc:1380] Generated new certificate authority record
I20260429 19:54:26.361286 10454 catalog_manager.cc:1514] Loading token signing keys...
I20260429 19:54:26.374881 10454 catalog_manager.cc:6044] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb: Generated new TSK 0
I20260429 19:54:26.376013 10454 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260429 19:54:26.387876 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.32.65:0
--local_ip_for_outbound_sockets=127.10.32.65
--webserver_interface=127.10.32.65
--webserver_port=0
--tserver_master_addrs=127.10.32.126:41131
--builtin_ntp_servers=127.10.32.84:40097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
W20260429 19:54:26.732218 10467 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:54:26.732558 10467 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:54:26.732672 10467 flags.cc:432] Enabled unsafe flag: --enable_log_gc=false
W20260429 19:54:26.732762 10467 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:54:26.741514 10467 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:54:26.741778 10467 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.32.65
I20260429 19:54:26.752303 10467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.32.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.32.65
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.10.32.126:41131
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.32.65
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:54:26.754164 10467 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:54:26.756042 10467 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260429 19:54:26.759893 10467 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260429 19:54:26.766225 10473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:54:26.766252 10472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:54:26.766952 10475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:54:26.767434 10467 server_base.cc:1061] running on GCE node
I20260429 19:54:26.768080 10467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 19:54:26.769121 10467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:54:26.770367 10467 hybrid_clock.cc:648] HybridClock initialized: now 1777492466770321 us; error 37 us; skew 500 ppm
I20260429 19:54:26.770740 10467 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:54:26.773221 10467 webserver.cc:492] Webserver started at http://127.10.32.65:38009/ using document root <none> and password file <none>
I20260429 19:54:26.774019 10467 fs_manager.cc:362] Metadata directory not provided
I20260429 19:54:26.774137 10467 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 19:54:26.774542 10467 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260429 19:54:26.777019 10467 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/data/instance:
uuid: "b874a660f9d74e30bd258ed4e690aea1"
format_stamp: "Formatted at 2026-04-29 19:54:26 on dist-test-slave-hwg5"
I20260429 19:54:26.777838 10467 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/wal/instance:
uuid: "b874a660f9d74e30bd258ed4e690aea1"
format_stamp: "Formatted at 2026-04-29 19:54:26 on dist-test-slave-hwg5"
I20260429 19:54:26.783469 10467 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260429 19:54:26.787102 10481 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:54:26.788584 10467 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260429 19:54:26.788779 10467 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/wal
uuid: "b874a660f9d74e30bd258ed4e690aea1"
format_stamp: "Formatted at 2026-04-29 19:54:26 on dist-test-slave-hwg5"
I20260429 19:54:26.788978 10467 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 19:54:26.816395 10467 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:54:26.817312 10467 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:54:26.817612 10467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:54:26.818629 10467 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 19:54:26.820349 10467 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260429 19:54:26.820451 10467 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260429 19:54:26.820585 10467 ts_tablet_manager.cc:616] Registered 0 tablets
I20260429 19:54:26.820665 10467 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260429 19:54:26.853205 10467 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.65:42197
I20260429 19:54:26.853271 10593 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.65:42197 every 8 connection(s)
I20260429 19:54:26.854717 10467 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/data/info.pb
I20260429 19:54:26.856333 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 10467
I20260429 19:54:26.856540 10369 external_mini_cluster.cc:1442] Reading /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/wal/instance
I20260429 19:54:26.860486 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.32.66:0
--local_ip_for_outbound_sockets=127.10.32.66
--webserver_interface=127.10.32.66
--webserver_port=0
--tserver_master_addrs=127.10.32.126:41131
--builtin_ntp_servers=127.10.32.84:40097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
I20260429 19:54:26.869320 10594 heartbeater.cc:344] Connected to a master server at 127.10.32.126:41131
I20260429 19:54:26.869730 10594 heartbeater.cc:461] Registering TS with master...
I20260429 19:54:26.870617 10594 heartbeater.cc:507] Master 127.10.32.126:41131 requested a full tablet report, sending...
I20260429 19:54:26.873037 10408 ts_manager.cc:194] Registered new tserver with Master: b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197)
I20260429 19:54:26.874675 10408 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.32.65:57733
W20260429 19:54:27.198099 10598 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:54:27.198501 10598 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:54:27.198604 10598 flags.cc:432] Enabled unsafe flag: --enable_log_gc=false
W20260429 19:54:27.198770 10598 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:54:27.207803 10598 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:54:27.208038 10598 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.32.66
I20260429 19:54:27.218705 10598 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.32.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.32.66
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.10.32.126:41131
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.32.66
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:54:27.220350 10598 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:54:27.222234 10598 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260429 19:54:27.226325 10598 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260429 19:54:27.232908 10604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:54:27.232975 10603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:54:27.232972 10606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:54:27.233634 10598 server_base.cc:1061] running on GCE node
I20260429 19:54:27.234315 10598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 19:54:27.235394 10598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:54:27.236627 10598 hybrid_clock.cc:648] HybridClock initialized: now 1777492467236565 us; error 57 us; skew 500 ppm
I20260429 19:54:27.236955 10598 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:54:27.239300 10598 webserver.cc:492] Webserver started at http://127.10.32.66:33171/ using document root <none> and password file <none>
I20260429 19:54:27.240083 10598 fs_manager.cc:362] Metadata directory not provided
I20260429 19:54:27.240190 10598 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 19:54:27.240522 10598 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260429 19:54:27.243036 10598 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-1/data/instance:
uuid: "5db99103528644b2b88c22cbd1a26046"
format_stamp: "Formatted at 2026-04-29 19:54:27 on dist-test-slave-hwg5"
I20260429 19:54:27.243829 10598 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-1/wal/instance:
uuid: "5db99103528644b2b88c22cbd1a26046"
format_stamp: "Formatted at 2026-04-29 19:54:27 on dist-test-slave-hwg5"
I20260429 19:54:27.249693 10598 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260429 19:54:27.253530 10612 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:54:27.255112 10598 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260429 19:54:27.255306 10598 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-1/wal
uuid: "5db99103528644b2b88c22cbd1a26046"
format_stamp: "Formatted at 2026-04-29 19:54:27 on dist-test-slave-hwg5"
I20260429 19:54:27.255504 10598 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 19:54:27.275556 10598 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:54:27.276484 10598 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:54:27.276767 10598 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:54:27.277840 10598 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 19:54:27.279911 10598 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260429 19:54:27.280021 10598 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260429 19:54:27.280135 10598 ts_tablet_manager.cc:616] Registered 0 tablets
I20260429 19:54:27.280216 10598 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260429 19:54:27.313452 10598 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.66:41183
I20260429 19:54:27.313501 10724 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.66:41183 every 8 connection(s)
I20260429 19:54:27.314934 10598 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-1/data/info.pb
I20260429 19:54:27.319160 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 10598
I20260429 19:54:27.319343 10369 external_mini_cluster.cc:1442] Reading /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-1/wal/instance
I20260429 19:54:27.323277 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.32.67:0
--local_ip_for_outbound_sockets=127.10.32.67
--webserver_interface=127.10.32.67
--webserver_port=0
--tserver_master_addrs=127.10.32.126:41131
--builtin_ntp_servers=127.10.32.84:40097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
I20260429 19:54:27.329174 10725 heartbeater.cc:344] Connected to a master server at 127.10.32.126:41131
I20260429 19:54:27.329555 10725 heartbeater.cc:461] Registering TS with master...
I20260429 19:54:27.330485 10725 heartbeater.cc:507] Master 127.10.32.126:41131 requested a full tablet report, sending...
I20260429 19:54:27.332068 10408 ts_manager.cc:194] Registered new tserver with Master: 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183)
I20260429 19:54:27.332872 10408 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.32.66:55089
W20260429 19:54:27.656601 10728 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:54:27.656944 10728 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:54:27.657033 10728 flags.cc:432] Enabled unsafe flag: --enable_log_gc=false
W20260429 19:54:27.657126 10728 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:54:27.665966 10728 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:54:27.666206 10728 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.32.67
I20260429 19:54:27.676586 10728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.32.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.32.67
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.10.32.126:41131
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.32.67
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:54:27.678220 10728 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:54:27.680075 10728 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260429 19:54:27.683954 10728 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260429 19:54:27.690412 10734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:54:27.690536 10733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:54:27.691144 10736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:54:27.692085 10728 server_base.cc:1061] running on GCE node
I20260429 19:54:27.692721 10728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 19:54:27.693795 10728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:54:27.695001 10728 hybrid_clock.cc:648] HybridClock initialized: now 1777492467694947 us; error 42 us; skew 500 ppm
I20260429 19:54:27.695323 10728 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:54:27.697721 10728 webserver.cc:492] Webserver started at http://127.10.32.67:36097/ using document root <none> and password file <none>
I20260429 19:54:27.698573 10728 fs_manager.cc:362] Metadata directory not provided
I20260429 19:54:27.698691 10728 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 19:54:27.699158 10728 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260429 19:54:27.701957 10728 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-2/data/instance:
uuid: "9b091bf2bbc547978432dfe2dbc1ffcd"
format_stamp: "Formatted at 2026-04-29 19:54:27 on dist-test-slave-hwg5"
I20260429 19:54:27.702864 10728 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-2/wal/instance:
uuid: "9b091bf2bbc547978432dfe2dbc1ffcd"
format_stamp: "Formatted at 2026-04-29 19:54:27 on dist-test-slave-hwg5"
I20260429 19:54:27.708482 10728 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260429 19:54:27.712473 10742 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:54:27.714027 10728 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260429 19:54:27.714195 10728 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-2/wal
uuid: "9b091bf2bbc547978432dfe2dbc1ffcd"
format_stamp: "Formatted at 2026-04-29 19:54:27 on dist-test-slave-hwg5"
I20260429 19:54:27.714368 10728 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 19:54:27.746460 10728 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:54:27.747493 10728 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:54:27.747757 10728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:54:27.748719 10728 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 19:54:27.750478 10728 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260429 19:54:27.750572 10728 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260429 19:54:27.750646 10728 ts_tablet_manager.cc:616] Registered 0 tablets
I20260429 19:54:27.750706 10728 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260429 19:54:27.781071 10728 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.67:38317
I20260429 19:54:27.781162 10854 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.67:38317 every 8 connection(s)
I20260429 19:54:27.782567 10728 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-2/data/info.pb
I20260429 19:54:27.792165 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 10728
I20260429 19:54:27.792351 10369 external_mini_cluster.cc:1442] Reading /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-2/wal/instance
I20260429 19:54:27.796206 10855 heartbeater.cc:344] Connected to a master server at 127.10.32.126:41131
I20260429 19:54:27.796628 10855 heartbeater.cc:461] Registering TS with master...
I20260429 19:54:27.797484 10855 heartbeater.cc:507] Master 127.10.32.126:41131 requested a full tablet report, sending...
I20260429 19:54:27.799021 10408 ts_manager.cc:194] Registered new tserver with Master: 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:27.799891 10408 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.32.67:47399
I20260429 19:54:27.809964 10369 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20260429 19:54:27.855118 10408 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35586:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\004\001\000UUU\025\004\001\000\252\252\252*\004\001\000\377\377\377?\004\001\000TUUU\004\001\000\251\252\252j"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260429 19:54:27.857067 10408 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260429 19:54:27.877732 10594 heartbeater.cc:499] Master 127.10.32.126:41131 was elected leader, sending a full tablet report...
I20260429 19:54:27.895637 10524 tablet_service.cc:1511] Processing CreateTablet for tablet 815a20bb06ab452d8dcf0ca2592b5f5d (DEFAULT_TABLE table=test-workload [id=8634708f79084c0190cff88f97e37d71]), partition=RANGE (key) PARTITION 1789569705 <= VALUES
I20260429 19:54:27.896417 10527 tablet_service.cc:1511] Processing CreateTablet for tablet de046e6b43a7413fa6e9a65e426f4721 (DEFAULT_TABLE table=test-workload [id=8634708f79084c0190cff88f97e37d71]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1073741823
I20260429 19:54:27.895751 10529 tablet_service.cc:1511] Processing CreateTablet for tablet 3449d2f7451d4a758233c5a1372a2960 (DEFAULT_TABLE table=test-workload [id=8634708f79084c0190cff88f97e37d71]), partition=RANGE (key) PARTITION VALUES < 357913941
I20260429 19:54:27.896464 10528 tablet_service.cc:1511] Processing CreateTablet for tablet b920d515ed1846c2a4b44b05f05f9886 (DEFAULT_TABLE table=test-workload [id=8634708f79084c0190cff88f97e37d71]), partition=RANGE (key) PARTITION 357913941 <= VALUES < 715827882
I20260429 19:54:27.896055 10525 tablet_service.cc:1511] Processing CreateTablet for tablet 94d4a1fea40d4f60866e5c4e8d75c743 (DEFAULT_TABLE table=test-workload [id=8634708f79084c0190cff88f97e37d71]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1789569705
I20260429 19:54:27.896586 10526 tablet_service.cc:1511] Processing CreateTablet for tablet f841352e6f584a97a0f2801c9d8651a7 (DEFAULT_TABLE table=test-workload [id=8634708f79084c0190cff88f97e37d71]), partition=RANGE (key) PARTITION 1073741823 <= VALUES < 1431655764
I20260429 19:54:27.897889 10527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de046e6b43a7413fa6e9a65e426f4721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:54:27.898718 10529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3449d2f7451d4a758233c5a1372a2960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:54:27.898924 10658 tablet_service.cc:1511] Processing CreateTablet for tablet de046e6b43a7413fa6e9a65e426f4721 (DEFAULT_TABLE table=test-workload [id=8634708f79084c0190cff88f97e37d71]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1073741823
I20260429 19:54:27.899156 10660 tablet_service.cc:1511] Processing CreateTablet for tablet 3449d2f7451d4a758233c5a1372a2960 (DEFAULT_TABLE table=test-workload [id=8634708f79084c0190cff88f97e37d71]), partition=RANGE (key) PARTITION VALUES < 357913941
I20260429 19:54:27.900396 10657 tablet_service.cc:1511] Processing CreateTablet for tablet f841352e6f584a97a0f2801c9d8651a7 (DEFAULT_TABLE table=test-workload [id=8634708f79084c0190cff88f97e37d71]), partition=RANGE (key) PARTITION 1073741823 <= VALUES < 1431655764
I20260429 19:54:27.900676 10660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3449d2f7451d4a758233c5a1372a2960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:54:27.900828 10525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94d4a1fea40d4f60866e5c4e8d75c743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:54:27.901161 10658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de046e6b43a7413fa6e9a65e426f4721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:54:27.901583 10526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f841352e6f584a97a0f2801c9d8651a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:54:27.901958 10524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 815a20bb06ab452d8dcf0ca2592b5f5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:54:27.902047 10657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f841352e6f584a97a0f2801c9d8651a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:54:27.898531 10659 tablet_service.cc:1511] Processing CreateTablet for tablet b920d515ed1846c2a4b44b05f05f9886 (DEFAULT_TABLE table=test-workload [id=8634708f79084c0190cff88f97e37d71]), partition=RANGE (key) PARTITION 357913941 <= VALUES < 715827882
I20260429 19:54:27.902298 10528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b920d515ed1846c2a4b44b05f05f9886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:54:27.902666 10659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b920d515ed1846c2a4b44b05f05f9886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:54:27.904076 10656 tablet_service.cc:1511] Processing CreateTablet for tablet 94d4a1fea40d4f60866e5c4e8d75c743 (DEFAULT_TABLE table=test-workload [id=8634708f79084c0190cff88f97e37d71]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1789569705
I20260429 19:54:27.904582 10656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94d4a1fea40d4f60866e5c4e8d75c743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:54:27.915076 10655 tablet_service.cc:1511] Processing CreateTablet for tablet 815a20bb06ab452d8dcf0ca2592b5f5d (DEFAULT_TABLE table=test-workload [id=8634708f79084c0190cff88f97e37d71]), partition=RANGE (key) PARTITION 1789569705 <= VALUES
I20260429 19:54:27.915668 10655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 815a20bb06ab452d8dcf0ca2592b5f5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:54:27.921334 10790 tablet_service.cc:1511] Processing CreateTablet for tablet 3449d2f7451d4a758233c5a1372a2960 (DEFAULT_TABLE table=test-workload [id=8634708f79084c0190cff88f97e37d71]), partition=RANGE (key) PARTITION VALUES < 357913941
I20260429 19:54:27.922861 10789 tablet_service.cc:1511] Processing CreateTablet for tablet b920d515ed1846c2a4b44b05f05f9886 (DEFAULT_TABLE table=test-workload [id=8634708f79084c0190cff88f97e37d71]), partition=RANGE (key) PARTITION 357913941 <= VALUES < 715827882
I20260429 19:54:27.923661 10790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3449d2f7451d4a758233c5a1372a2960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:54:27.924122 10788 tablet_service.cc:1511] Processing CreateTablet for tablet de046e6b43a7413fa6e9a65e426f4721 (DEFAULT_TABLE table=test-workload [id=8634708f79084c0190cff88f97e37d71]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1073741823
I20260429 19:54:27.924577 10788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de046e6b43a7413fa6e9a65e426f4721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:54:27.925347 10789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b920d515ed1846c2a4b44b05f05f9886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:54:27.926990 10787 tablet_service.cc:1511] Processing CreateTablet for tablet f841352e6f584a97a0f2801c9d8651a7 (DEFAULT_TABLE table=test-workload [id=8634708f79084c0190cff88f97e37d71]), partition=RANGE (key) PARTITION 1073741823 <= VALUES < 1431655764
I20260429 19:54:27.927453 10787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f841352e6f584a97a0f2801c9d8651a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:54:27.930895 10878 tablet_bootstrap.cc:492] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046: Bootstrap starting.
I20260429 19:54:27.941249 10878 tablet_bootstrap.cc:654] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046: Neither blocks nor log segments found. Creating new log.
I20260429 19:54:27.945592 10879 tablet_bootstrap.cc:492] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1: Bootstrap starting.
I20260429 19:54:27.945523 10789 tablet_service.cc:1511] Processing CreateTablet for tablet 94d4a1fea40d4f60866e5c4e8d75c743 (DEFAULT_TABLE table=test-workload [id=8634708f79084c0190cff88f97e37d71]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1789569705
I20260429 19:54:27.945802 10878 log.cc:826] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046: Log is configured to *not* fsync() on all Append() calls
I20260429 19:54:27.945966 10789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94d4a1fea40d4f60866e5c4e8d75c743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:54:27.946022 10788 tablet_service.cc:1511] Processing CreateTablet for tablet 815a20bb06ab452d8dcf0ca2592b5f5d (DEFAULT_TABLE table=test-workload [id=8634708f79084c0190cff88f97e37d71]), partition=RANGE (key) PARTITION 1789569705 <= VALUES
I20260429 19:54:27.946511 10788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 815a20bb06ab452d8dcf0ca2592b5f5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:54:27.949637 10879 tablet_bootstrap.cc:654] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1: Neither blocks nor log segments found. Creating new log.
I20260429 19:54:27.952095 10879 log.cc:826] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1: Log is configured to *not* fsync() on all Append() calls
I20260429 19:54:27.952581 10880 tablet_bootstrap.cc:492] T f841352e6f584a97a0f2801c9d8651a7 P 9b091bf2bbc547978432dfe2dbc1ffcd: Bootstrap starting.
I20260429 19:54:27.955514 10878 tablet_bootstrap.cc:492] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046: No bootstrap required, opened a new log
I20260429 19:54:27.955824 10878 ts_tablet_manager.cc:1403] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046: Time spent bootstrapping tablet: real 0.026s user 0.012s sys 0.006s
I20260429 19:54:27.955996 10879 tablet_bootstrap.cc:492] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1: No bootstrap required, opened a new log
I20260429 19:54:27.956288 10879 ts_tablet_manager.cc:1403] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260429 19:54:27.956794 10880 tablet_bootstrap.cc:654] T f841352e6f584a97a0f2801c9d8651a7 P 9b091bf2bbc547978432dfe2dbc1ffcd: Neither blocks nor log segments found. Creating new log.
I20260429 19:54:27.958168 10880 log.cc:826] T f841352e6f584a97a0f2801c9d8651a7 P 9b091bf2bbc547978432dfe2dbc1ffcd: Log is configured to *not* fsync() on all Append() calls
I20260429 19:54:27.961436 10880 tablet_bootstrap.cc:492] T f841352e6f584a97a0f2801c9d8651a7 P 9b091bf2bbc547978432dfe2dbc1ffcd: No bootstrap required, opened a new log
I20260429 19:54:27.961761 10880 ts_tablet_manager.cc:1403] T f841352e6f584a97a0f2801c9d8651a7 P 9b091bf2bbc547978432dfe2dbc1ffcd: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.000s
I20260429 19:54:27.962301 10878 raft_consensus.cc:359] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:27.962677 10878 raft_consensus.cc:385] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:54:27.962778 10878 raft_consensus.cc:740] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5db99103528644b2b88c22cbd1a26046, State: Initialized, Role: FOLLOWER
I20260429 19:54:27.963207 10879 raft_consensus.cc:359] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:27.963598 10879 raft_consensus.cc:385] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:54:27.963696 10879 raft_consensus.cc:740] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b874a660f9d74e30bd258ed4e690aea1, State: Initialized, Role: FOLLOWER
I20260429 19:54:27.963588 10878 consensus_queue.cc:260] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:27.964365 10879 consensus_queue.cc:260] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:27.964862 10725 heartbeater.cc:499] Master 127.10.32.126:41131 was elected leader, sending a full tablet report...
I20260429 19:54:27.965474 10878 ts_tablet_manager.cc:1434] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260429 19:54:27.966073 10878 tablet_bootstrap.cc:492] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046: Bootstrap starting.
I20260429 19:54:27.968143 10878 tablet_bootstrap.cc:654] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046: Neither blocks nor log segments found. Creating new log.
I20260429 19:54:27.969961 10880 raft_consensus.cc:359] T f841352e6f584a97a0f2801c9d8651a7 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:27.970480 10880 raft_consensus.cc:385] T f841352e6f584a97a0f2801c9d8651a7 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:54:27.970607 10880 raft_consensus.cc:740] T f841352e6f584a97a0f2801c9d8651a7 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b091bf2bbc547978432dfe2dbc1ffcd, State: Initialized, Role: FOLLOWER
I20260429 19:54:27.971554 10880 consensus_queue.cc:260] T f841352e6f584a97a0f2801c9d8651a7 P 9b091bf2bbc547978432dfe2dbc1ffcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:27.973467 10879 ts_tablet_manager.cc:1434] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1: Time spent starting tablet: real 0.017s user 0.017s sys 0.000s
I20260429 19:54:27.974045 10879 tablet_bootstrap.cc:492] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1: Bootstrap starting.
I20260429 19:54:27.976289 10879 tablet_bootstrap.cc:654] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1: Neither blocks nor log segments found. Creating new log.
I20260429 19:54:27.983601 10884 raft_consensus.cc:493] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:54:27.983923 10884 raft_consensus.cc:515] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:27.984584 10855 heartbeater.cc:499] Master 127.10.32.126:41131 was elected leader, sending a full tablet report...
I20260429 19:54:27.985481 10880 ts_tablet_manager.cc:1434] T f841352e6f584a97a0f2801c9d8651a7 P 9b091bf2bbc547978432dfe2dbc1ffcd: Time spent starting tablet: real 0.024s user 0.016s sys 0.008s
I20260429 19:54:27.987335 10878 tablet_bootstrap.cc:492] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046: No bootstrap required, opened a new log
I20260429 19:54:27.987928 10880 tablet_bootstrap.cc:492] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd: Bootstrap starting.
I20260429 19:54:27.990159 10880 tablet_bootstrap.cc:654] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd: Neither blocks nor log segments found. Creating new log.
I20260429 19:54:27.986322 10884 leader_election.cc:290] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:27.990572 10878 ts_tablet_manager.cc:1403] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046: Time spent bootstrapping tablet: real 0.025s user 0.011s sys 0.007s
I20260429 19:54:27.991113 10879 tablet_bootstrap.cc:492] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1: No bootstrap required, opened a new log
I20260429 19:54:27.991284 10879 ts_tablet_manager.cc:1403] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.004s
I20260429 19:54:27.991928 10878 raft_consensus.cc:359] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:27.992229 10878 raft_consensus.cc:385] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:54:27.992202 10879 raft_consensus.cc:359] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:27.992385 10879 raft_consensus.cc:385] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:54:27.992424 10878 raft_consensus.cc:740] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5db99103528644b2b88c22cbd1a26046, State: Initialized, Role: FOLLOWER
I20260429 19:54:27.992472 10879 raft_consensus.cc:740] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b874a660f9d74e30bd258ed4e690aea1, State: Initialized, Role: FOLLOWER
I20260429 19:54:27.992741 10879 consensus_queue.cc:260] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:27.992741 10878 consensus_queue.cc:260] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:27.993286 10879 ts_tablet_manager.cc:1434] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260429 19:54:27.993569 10879 tablet_bootstrap.cc:492] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1: Bootstrap starting.
I20260429 19:54:27.994073 10878 ts_tablet_manager.cc:1434] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260429 19:54:27.996492 10879 tablet_bootstrap.cc:654] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1: Neither blocks nor log segments found. Creating new log.
I20260429 19:54:27.999048 10878 tablet_bootstrap.cc:492] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046: Bootstrap starting.
I20260429 19:54:28.000594 10884 raft_consensus.cc:493] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:54:28.000803 10884 raft_consensus.cc:515] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.001310 10878 tablet_bootstrap.cc:654] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046: Neither blocks nor log segments found. Creating new log.
I20260429 19:54:28.001648 10884 leader_election.cc:290] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:28.004752 10879 tablet_bootstrap.cc:492] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1: No bootstrap required, opened a new log
I20260429 19:54:28.004966 10879 ts_tablet_manager.cc:1403] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.003s
I20260429 19:54:28.005848 10879 raft_consensus.cc:359] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.006089 10879 raft_consensus.cc:385] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:54:28.006182 10879 raft_consensus.cc:740] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b874a660f9d74e30bd258ed4e690aea1, State: Initialized, Role: FOLLOWER
I20260429 19:54:28.006541 10879 consensus_queue.cc:260] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.007730 10879 ts_tablet_manager.cc:1434] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260429 19:54:28.008103 10879 tablet_bootstrap.cc:492] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1: Bootstrap starting.
I20260429 19:54:28.009963 10879 tablet_bootstrap.cc:654] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1: Neither blocks nor log segments found. Creating new log.
I20260429 19:54:28.013773 10810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d4a1fea40d4f60866e5c4e8d75c743" candidate_uuid: "5db99103528644b2b88c22cbd1a26046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:28.015344 10810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "5db99103528644b2b88c22cbd1a26046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:28.015760 10810 raft_consensus.cc:2468] T f841352e6f584a97a0f2801c9d8651a7 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5db99103528644b2b88c22cbd1a26046 in term 0.
W20260429 19:54:28.016500 10614 leader_election.cc:343] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317): Illegal state: must be running to vote when last-logged opid is not known
I20260429 19:54:28.016889 10614 leader_election.cc:304] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd; no voters:
I20260429 19:54:28.017114 10878 tablet_bootstrap.cc:492] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046: No bootstrap required, opened a new log
I20260429 19:54:28.017334 10878 ts_tablet_manager.cc:1403] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046: Time spent bootstrapping tablet: real 0.018s user 0.011s sys 0.005s
I20260429 19:54:28.018070 10884 raft_consensus.cc:2804] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 19:54:28.018193 10884 raft_consensus.cc:493] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 19:54:28.018321 10884 raft_consensus.cc:3060] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Advancing to term 1
I20260429 19:54:28.018270 10878 raft_consensus.cc:359] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.018556 10878 raft_consensus.cc:385] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:54:28.018651 10878 raft_consensus.cc:740] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5db99103528644b2b88c22cbd1a26046, State: Initialized, Role: FOLLOWER
I20260429 19:54:28.018949 10878 consensus_queue.cc:260] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.020635 10880 tablet_bootstrap.cc:492] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd: No bootstrap required, opened a new log
I20260429 19:54:28.020817 10880 ts_tablet_manager.cc:1403] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd: Time spent bootstrapping tablet: real 0.033s user 0.015s sys 0.012s
I20260429 19:54:28.021797 10549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d4a1fea40d4f60866e5c4e8d75c743" candidate_uuid: "5db99103528644b2b88c22cbd1a26046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b874a660f9d74e30bd258ed4e690aea1" is_pre_election: true
I20260429 19:54:28.021919 10880 raft_consensus.cc:359] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.022156 10880 raft_consensus.cc:385] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:54:28.022138 10884 raft_consensus.cc:515] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.022241 10880 raft_consensus.cc:740] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b091bf2bbc547978432dfe2dbc1ffcd, State: Initialized, Role: FOLLOWER
I20260429 19:54:28.022626 10548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "5db99103528644b2b88c22cbd1a26046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b874a660f9d74e30bd258ed4e690aea1" is_pre_election: true
I20260429 19:54:28.023272 10884 leader_election.cc:290] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 1 election: Requested vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:28.023540 10879 tablet_bootstrap.cc:492] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1: No bootstrap required, opened a new log
I20260429 19:54:28.023725 10879 ts_tablet_manager.cc:1403] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
W20260429 19:54:28.024199 10616 leader_election.cc:343] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Illegal state: must be running to vote when last-logged opid is not known
I20260429 19:54:28.024312 10810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "5db99103528644b2b88c22cbd1a26046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd"
I20260429 19:54:28.024533 10810 raft_consensus.cc:3060] T f841352e6f584a97a0f2801c9d8651a7 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Advancing to term 1
I20260429 19:54:28.024634 10879 raft_consensus.cc:359] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.024812 10879 raft_consensus.cc:385] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:54:28.024840 10548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "5db99103528644b2b88c22cbd1a26046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b874a660f9d74e30bd258ed4e690aea1"
I20260429 19:54:28.024909 10879 raft_consensus.cc:740] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b874a660f9d74e30bd258ed4e690aea1, State: Initialized, Role: FOLLOWER
I20260429 19:54:28.025326 10885 raft_consensus.cc:493] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:54:28.025343 10880 consensus_queue.cc:260] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.025532 10885 raft_consensus.cc:515] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.025699 10879 consensus_queue.cc:260] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.027184 10880 ts_tablet_manager.cc:1434] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260429 19:54:28.027488 10880 tablet_bootstrap.cc:492] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd: Bootstrap starting.
I20260429 19:54:28.027626 10885 leader_election.cc:290] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:28.027652 10810 raft_consensus.cc:2468] T f841352e6f584a97a0f2801c9d8651a7 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5db99103528644b2b88c22cbd1a26046 in term 1.
I20260429 19:54:28.028128 10614 leader_election.cc:304] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd; no voters:
I20260429 19:54:28.029433 10880 tablet_bootstrap.cc:654] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd: Neither blocks nor log segments found. Creating new log.
I20260429 19:54:28.031195 10884 raft_consensus.cc:2804] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 19:54:28.031427 10878 ts_tablet_manager.cc:1434] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046: Time spent starting tablet: real 0.014s user 0.006s sys 0.003s
W20260429 19:54:28.031174 10616 leader_election.cc:343] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Illegal state: must be running to vote when last-logged opid is not known
I20260429 19:54:28.032263 10884 raft_consensus.cc:697] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [term 1 LEADER]: Becoming Leader. State: Replica: 5db99103528644b2b88c22cbd1a26046, State: Running, Role: LEADER
I20260429 19:54:28.032330 10878 tablet_bootstrap.cc:492] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046: Bootstrap starting.
I20260429 19:54:28.032394 10879 ts_tablet_manager.cc:1434] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1: Time spent starting tablet: real 0.009s user 0.004s sys 0.000s
W20260429 19:54:28.032356 10616 leader_election.cc:343] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Illegal state: must be running to vote when last-logged opid is not known
I20260429 19:54:28.032506 10616 leader_election.cc:304] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5db99103528644b2b88c22cbd1a26046; no voters: 9b091bf2bbc547978432dfe2dbc1ffcd, b874a660f9d74e30bd258ed4e690aea1
I20260429 19:54:28.032701 10879 tablet_bootstrap.cc:492] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1: Bootstrap starting.
I20260429 19:54:28.033056 10884 consensus_queue.cc:237] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
W20260429 19:54:28.034179 10856 tablet.cc:2404] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260429 19:54:28.034583 10879 tablet_bootstrap.cc:654] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1: Neither blocks nor log segments found. Creating new log.
I20260429 19:54:28.035306 10878 tablet_bootstrap.cc:654] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046: Neither blocks nor log segments found. Creating new log.
I20260429 19:54:28.036276 10895 raft_consensus.cc:2749] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260429 19:54:28.043440 10879 tablet_bootstrap.cc:492] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1: No bootstrap required, opened a new log
I20260429 19:54:28.043453 10878 tablet_bootstrap.cc:492] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046: No bootstrap required, opened a new log
I20260429 19:54:28.043640 10878 ts_tablet_manager.cc:1403] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.006s
I20260429 19:54:28.043910 10879 ts_tablet_manager.cc:1403] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.004s
I20260429 19:54:28.044595 10878 raft_consensus.cc:359] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.044835 10878 raft_consensus.cc:385] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:54:28.044931 10878 raft_consensus.cc:740] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5db99103528644b2b88c22cbd1a26046, State: Initialized, Role: FOLLOWER
I20260429 19:54:28.044972 10879 raft_consensus.cc:359] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.045186 10878 consensus_queue.cc:260] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.045281 10879 raft_consensus.cc:385] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:54:28.045475 10879 raft_consensus.cc:740] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b874a660f9d74e30bd258ed4e690aea1, State: Initialized, Role: FOLLOWER
I20260429 19:54:28.045837 10878 ts_tablet_manager.cc:1434] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260429 19:54:28.045789 10879 consensus_queue.cc:260] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.046471 10879 ts_tablet_manager.cc:1434] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260429 19:54:28.046586 10878 tablet_bootstrap.cc:492] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046: Bootstrap starting.
I20260429 19:54:28.047137 10879 tablet_bootstrap.cc:492] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1: Bootstrap starting.
I20260429 19:54:28.048461 10878 tablet_bootstrap.cc:654] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046: Neither blocks nor log segments found. Creating new log.
I20260429 19:54:28.049626 10879 tablet_bootstrap.cc:654] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1: Neither blocks nor log segments found. Creating new log.
I20260429 19:54:28.053308 10896 raft_consensus.cc:493] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:54:28.053488 10896 raft_consensus.cc:515] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.054422 10896 leader_election.cc:290] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:28.054327 10408 catalog_manager.cc:5671] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5db99103528644b2b88c22cbd1a26046 (127.10.32.66). New cstate: current_term: 1 leader_uuid: "5db99103528644b2b88c22cbd1a26046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } health_report { overall_health: UNKNOWN } } }
I20260429 19:54:28.055742 10880 tablet_bootstrap.cc:492] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd: No bootstrap required, opened a new log
I20260429 19:54:28.055924 10880 ts_tablet_manager.cc:1403] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.008s
I20260429 19:54:28.056779 10880 raft_consensus.cc:359] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.056993 10880 raft_consensus.cc:385] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:54:28.057063 10880 raft_consensus.cc:740] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b091bf2bbc547978432dfe2dbc1ffcd, State: Initialized, Role: FOLLOWER
I20260429 19:54:28.057298 10880 consensus_queue.cc:260] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.057794 10880 ts_tablet_manager.cc:1434] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260429 19:54:28.058143 10880 tablet_bootstrap.cc:492] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd: Bootstrap starting.
I20260429 19:54:28.059899 10880 tablet_bootstrap.cc:654] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd: Neither blocks nor log segments found. Creating new log.
I20260429 19:54:28.064417 10810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b920d515ed1846c2a4b44b05f05f9886" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:28.064960 10809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3449d2f7451d4a758233c5a1372a2960" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:28.065274 10809 raft_consensus.cc:2468] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b874a660f9d74e30bd258ed4e690aea1 in term 0.
W20260429 19:54:28.066859 10726 tablet.cc:2404] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260429 19:54:28.066709 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3449d2f7451d4a758233c5a1372a2960" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:28.067636 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b920d515ed1846c2a4b44b05f05f9886" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:28.068028 10680 raft_consensus.cc:2468] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b874a660f9d74e30bd258ed4e690aea1 in term 0.
W20260429 19:54:28.069092 10483 leader_election.cc:343] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317): Illegal state: must be running to vote when last-logged opid is not known
I20260429 19:54:28.069239 10884 raft_consensus.cc:493] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260429 19:54:28.069437 10483 leader_election.cc:343] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183): Illegal state: must be running to vote when last-logged opid is not known
I20260429 19:54:28.069384 10884 raft_consensus.cc:515] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.069645 10483 leader_election.cc:304] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5db99103528644b2b88c22cbd1a26046, b874a660f9d74e30bd258ed4e690aea1; no voters: 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:28.070099 10884 leader_election.cc:290] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:28.070379 10483 leader_election.cc:304] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b091bf2bbc547978432dfe2dbc1ffcd, b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046
I20260429 19:54:28.070835 10809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "5db99103528644b2b88c22cbd1a26046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:28.070974 10896 raft_consensus.cc:2804] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 19:54:28.071156 10896 raft_consensus.cc:493] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 19:54:28.071247 10896 raft_consensus.cc:3060] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Advancing to term 1
W20260429 19:54:28.071472 10614 leader_election.cc:343] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317): Illegal state: must be running to vote when last-logged opid is not known
I20260429 19:54:28.074641 10896 raft_consensus.cc:515] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.075407 10896 leader_election.cc:290] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 election: Requested vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:28.075675 10896 raft_consensus.cc:2804] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 19:54:28.075767 10896 raft_consensus.cc:493] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 19:54:28.075887 10896 raft_consensus.cc:3060] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Advancing to term 1
I20260429 19:54:28.078622 10885 raft_consensus.cc:493] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:54:28.078866 10885 raft_consensus.cc:515] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.079625 10885 leader_election.cc:290] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:28.080806 10810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:28.081295 10809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b920d515ed1846c2a4b44b05f05f9886" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd"
I20260429 19:54:28.082142 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b920d515ed1846c2a4b44b05f05f9886" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046"
I20260429 19:54:28.082381 10680 raft_consensus.cc:3060] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Advancing to term 1
I20260429 19:54:28.085824 10680 raft_consensus.cc:2468] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b874a660f9d74e30bd258ed4e690aea1 in term 1.
I20260429 19:54:28.086329 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:28.086467 10880 tablet_bootstrap.cc:492] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd: No bootstrap required, opened a new log
I20260429 19:54:28.086599 10679 raft_consensus.cc:2468] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b874a660f9d74e30bd258ed4e690aea1 in term 0.
I20260429 19:54:28.086555 10483 leader_election.cc:304] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5db99103528644b2b88c22cbd1a26046, b874a660f9d74e30bd258ed4e690aea1; no voters:
I20260429 19:54:28.086692 10880 ts_tablet_manager.cc:1403] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd: Time spent bootstrapping tablet: real 0.029s user 0.012s sys 0.011s
I20260429 19:54:28.086905 10885 raft_consensus.cc:2804] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 19:54:28.087064 10885 raft_consensus.cc:697] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 1 LEADER]: Becoming Leader. State: Replica: b874a660f9d74e30bd258ed4e690aea1, State: Running, Role: LEADER
I20260429 19:54:28.087641 10880 raft_consensus.cc:359] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.087867 10880 raft_consensus.cc:385] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:54:28.087677 10885 consensus_queue.cc:237] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.087797 10878 tablet_bootstrap.cc:492] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046: No bootstrap required, opened a new log
I20260429 19:54:28.087970 10880 raft_consensus.cc:740] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b091bf2bbc547978432dfe2dbc1ffcd, State: Initialized, Role: FOLLOWER
I20260429 19:54:28.088218 10878 ts_tablet_manager.cc:1403] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046: Time spent bootstrapping tablet: real 0.042s user 0.004s sys 0.034s
I20260429 19:54:28.088246 10880 consensus_queue.cc:260] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.088809 10880 ts_tablet_manager.cc:1434] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260429 19:54:28.089236 10880 tablet_bootstrap.cc:492] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd: Bootstrap starting.
I20260429 19:54:28.089212 10878 raft_consensus.cc:359] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.089541 10878 raft_consensus.cc:385] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:54:28.089669 10878 raft_consensus.cc:740] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5db99103528644b2b88c22cbd1a26046, State: Initialized, Role: FOLLOWER
W20260429 19:54:28.089718 10483 leader_election.cc:343] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317): Illegal state: must be running to vote when last-logged opid is not known
W20260429 19:54:28.089977 10483 leader_election.cc:343] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317): Illegal state: must be running to vote when last-logged opid is not known
I20260429 19:54:28.090018 10878 consensus_queue.cc:260] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.090740 10878 ts_tablet_manager.cc:1434] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260429 19:54:28.090752 10483 leader_election.cc:304] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5db99103528644b2b88c22cbd1a26046, b874a660f9d74e30bd258ed4e690aea1; no voters: 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:28.091173 10880 tablet_bootstrap.cc:654] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd: Neither blocks nor log segments found. Creating new log.
I20260429 19:54:28.091197 10878 tablet_bootstrap.cc:492] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046: Bootstrap starting.
I20260429 19:54:28.093056 10878 tablet_bootstrap.cc:654] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046: Neither blocks nor log segments found. Creating new log.
I20260429 19:54:28.104472 10880 tablet_bootstrap.cc:492] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd: No bootstrap required, opened a new log
I20260429 19:54:28.104714 10880 ts_tablet_manager.cc:1403] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.011s
I20260429 19:54:28.105628 10880 raft_consensus.cc:359] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.105880 10880 raft_consensus.cc:385] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:54:28.105957 10880 raft_consensus.cc:740] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b091bf2bbc547978432dfe2dbc1ffcd, State: Initialized, Role: FOLLOWER
I20260429 19:54:28.106212 10880 consensus_queue.cc:260] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.106894 10880 ts_tablet_manager.cc:1434] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260429 19:54:28.107203 10880 tablet_bootstrap.cc:492] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd: Bootstrap starting.
W20260429 19:54:28.108517 10595 tablet.cc:2404] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260429 19:54:28.108964 10880 tablet_bootstrap.cc:654] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd: Neither blocks nor log segments found. Creating new log.
I20260429 19:54:28.109295 10896 raft_consensus.cc:515] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.110055 10896 leader_election.cc:290] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 election: Requested vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:28.110616 10896 raft_consensus.cc:493] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:54:28.110788 10896 raft_consensus.cc:515] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.111415 10896 leader_election.cc:290] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:28.111598 10896 raft_consensus.cc:2804] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 19:54:28.111676 10896 raft_consensus.cc:493] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 19:54:28.111766 10896 raft_consensus.cc:3060] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Advancing to term 1
I20260429 19:54:28.112249 10884 raft_consensus.cc:493] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:54:28.112403 10884 raft_consensus.cc:515] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.113003 10884 leader_election.cc:290] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:28.114717 10895 consensus_queue.cc:1048] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 19:54:28.114871 10887 raft_consensus.cc:493] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:54:28.115101 10887 raft_consensus.cc:515] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.117216 10887 leader_election.cc:290] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183)
I20260429 19:54:28.117684 10880 tablet_bootstrap.cc:492] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd: No bootstrap required, opened a new log
I20260429 19:54:28.117875 10880 ts_tablet_manager.cc:1403] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260429 19:54:28.118709 10880 raft_consensus.cc:359] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.118909 10880 raft_consensus.cc:385] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:54:28.119002 10880 raft_consensus.cc:740] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b091bf2bbc547978432dfe2dbc1ffcd, State: Initialized, Role: FOLLOWER
I20260429 19:54:28.119228 10880 consensus_queue.cc:260] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.120404 10880 ts_tablet_manager.cc:1434] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260429 19:54:28.128077 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:28.128175 10809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3449d2f7451d4a758233c5a1372a2960" candidate_uuid: "5db99103528644b2b88c22cbd1a26046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:28.128398 10809 raft_consensus.cc:2468] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5db99103528644b2b88c22cbd1a26046 in term 0.
I20260429 19:54:28.128804 10614 leader_election.cc:304] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd; no voters:
I20260429 19:54:28.128988 10879 tablet_bootstrap.cc:492] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1: No bootstrap required, opened a new log
I20260429 19:54:28.129143 10879 ts_tablet_manager.cc:1403] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1: Time spent bootstrapping tablet: real 0.082s user 0.002s sys 0.012s
I20260429 19:54:28.129135 10895 raft_consensus.cc:2804] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 19:54:28.129230 10895 raft_consensus.cc:493] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 19:54:28.129323 10895 raft_consensus.cc:3060] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Advancing to term 1
I20260429 19:54:28.130071 10879 raft_consensus.cc:359] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.130245 10879 raft_consensus.cc:385] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:54:28.130316 10879 raft_consensus.cc:740] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b874a660f9d74e30bd258ed4e690aea1, State: Initialized, Role: FOLLOWER
I20260429 19:54:28.130563 10879 consensus_queue.cc:260] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
W20260429 19:54:28.130967 10744 leader_election.cc:343] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183): Illegal state: must be running to vote when last-logged opid is not known
I20260429 19:54:28.131178 10879 ts_tablet_manager.cc:1434] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260429 19:54:28.132308 10895 raft_consensus.cc:515] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.133162 10895 leader_election.cc:290] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 1 election: Requested vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:28.133664 10809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3449d2f7451d4a758233c5a1372a2960" candidate_uuid: "5db99103528644b2b88c22cbd1a26046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd"
I20260429 19:54:28.133890 10809 raft_consensus.cc:3060] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Advancing to term 1
W20260429 19:54:28.137763 10483 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.32.66:41183, user_credentials={real_user=slave}} blocked reactor thread for 46957us
I20260429 19:54:28.138741 10809 raft_consensus.cc:2468] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5db99103528644b2b88c22cbd1a26046 in term 1.
I20260429 19:54:28.138759 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3449d2f7451d4a758233c5a1372a2960" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046"
I20260429 19:54:28.139132 10679 raft_consensus.cc:2393] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b874a660f9d74e30bd258ed4e690aea1 in current term 1: Already voted for candidate 5db99103528644b2b88c22cbd1a26046 in this term.
I20260429 19:54:28.139310 10614 leader_election.cc:304] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd; no voters:
I20260429 19:54:28.139672 10884 raft_consensus.cc:2804] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 19:54:28.139809 10884 raft_consensus.cc:697] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [term 1 LEADER]: Becoming Leader. State: Replica: 5db99103528644b2b88c22cbd1a26046, State: Running, Role: LEADER
I20260429 19:54:28.140105 10884 consensus_queue.cc:237] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.140275 10885 raft_consensus.cc:493] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:54:28.140436 10885 raft_consensus.cc:515] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.141057 10885 leader_election.cc:290] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:28.141887 10549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "5db99103528644b2b88c22cbd1a26046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b874a660f9d74e30bd258ed4e690aea1" is_pre_election: true
I20260429 19:54:28.142410 10548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3449d2f7451d4a758233c5a1372a2960" candidate_uuid: "5db99103528644b2b88c22cbd1a26046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b874a660f9d74e30bd258ed4e690aea1" is_pre_election: true
I20260429 19:54:28.142750 10548 raft_consensus.cc:2393] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5db99103528644b2b88c22cbd1a26046 in current term 1: Already voted for candidate b874a660f9d74e30bd258ed4e690aea1 in this term.
I20260429 19:54:28.142961 10809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3449d2f7451d4a758233c5a1372a2960" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd"
I20260429 19:54:28.143290 10809 raft_consensus.cc:2393] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b874a660f9d74e30bd258ed4e690aea1 in current term 1: Already voted for candidate 5db99103528644b2b88c22cbd1a26046 in this term.
I20260429 19:54:28.143296 10548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3449d2f7451d4a758233c5a1372a2960" candidate_uuid: "5db99103528644b2b88c22cbd1a26046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b874a660f9d74e30bd258ed4e690aea1"
I20260429 19:54:28.143484 10548 raft_consensus.cc:2393] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5db99103528644b2b88c22cbd1a26046 in current term 1: Already voted for candidate b874a660f9d74e30bd258ed4e690aea1 in this term.
I20260429 19:54:28.143375 10408 catalog_manager.cc:5671] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5db99103528644b2b88c22cbd1a26046 (127.10.32.66). New cstate: current_term: 1 leader_uuid: "5db99103528644b2b88c22cbd1a26046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } health_report { overall_health: UNKNOWN } } }
I20260429 19:54:28.144230 10809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d4a1fea40d4f60866e5c4e8d75c743" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:28.144299 10548 raft_consensus.cc:3060] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Advancing to term 1
I20260429 19:54:28.144439 10809 raft_consensus.cc:2468] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b874a660f9d74e30bd258ed4e690aea1 in term 0.
I20260429 19:54:28.145670 10809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:28.145905 10809 raft_consensus.cc:2468] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b874a660f9d74e30bd258ed4e690aea1 in term 0.
I20260429 19:54:28.145920 10887 raft_consensus.cc:493] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:54:28.146741 10887 raft_consensus.cc:515] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.146910 10483 leader_election.cc:304] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b091bf2bbc547978432dfe2dbc1ffcd, b874a660f9d74e30bd258ed4e690aea1; no voters:
I20260429 19:54:28.147265 10483 leader_election.cc:304] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b091bf2bbc547978432dfe2dbc1ffcd, b874a660f9d74e30bd258ed4e690aea1; no voters:
I20260429 19:54:28.147354 10887 leader_election.cc:290] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183)
I20260429 19:54:28.147576 10483 leader_election.cc:304] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:28.148026 10907 raft_consensus.cc:2804] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 19:54:28.148125 10907 raft_consensus.cc:493] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 19:54:28.148242 10907 raft_consensus.cc:3060] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Advancing to term 1
I20260429 19:54:28.148680 10906 raft_consensus.cc:2804] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 19:54:28.148773 10906 raft_consensus.cc:493] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 19:54:28.148720 10678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b920d515ed1846c2a4b44b05f05f9886" candidate_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:28.148891 10906 raft_consensus.cc:3060] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 0 FOLLOWER]: Advancing to term 1
I20260429 19:54:28.149104 10678 raft_consensus.cc:2393] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b091bf2bbc547978432dfe2dbc1ffcd in current term 1: Already voted for candidate b874a660f9d74e30bd258ed4e690aea1 in this term.
I20260429 19:54:28.149267 10885 raft_consensus.cc:2749] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260429 19:54:28.149602 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d4a1fea40d4f60866e5c4e8d75c743" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:28.149798 10679 raft_consensus.cc:2468] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b874a660f9d74e30bd258ed4e690aea1 in term 0.
I20260429 19:54:28.151628 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:28.153054 10547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b874a660f9d74e30bd258ed4e690aea1" is_pre_election: true
I20260429 19:54:28.153230 10546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b920d515ed1846c2a4b44b05f05f9886" candidate_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b874a660f9d74e30bd258ed4e690aea1" is_pre_election: true
I20260429 19:54:28.152837 10408 catalog_manager.cc:5671] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65). New cstate: current_term: 1 leader_uuid: "b874a660f9d74e30bd258ed4e690aea1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } health_report { overall_health: UNKNOWN } } }
I20260429 19:54:28.154546 10896 raft_consensus.cc:515] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.154354 10746 leader_election.cc:304] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b091bf2bbc547978432dfe2dbc1ffcd; no voters: 5db99103528644b2b88c22cbd1a26046, b874a660f9d74e30bd258ed4e690aea1
I20260429 19:54:28.155170 10896 leader_election.cc:290] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 election: Requested vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:28.155325 10549 raft_consensus.cc:2393] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5db99103528644b2b88c22cbd1a26046 in current term 1: Already voted for candidate b874a660f9d74e30bd258ed4e690aea1 in this term.
I20260429 19:54:28.155496 10887 raft_consensus.cc:3060] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Advancing to term 1
W20260429 19:54:28.155853 10483 leader_election.cc:343] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183): Illegal state: must be running to vote when last-logged opid is not known
I20260429 19:54:28.159942 10908 raft_consensus.cc:493] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:54:28.160223 10908 raft_consensus.cc:515] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.160557 10616 leader_election.cc:304] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5db99103528644b2b88c22cbd1a26046; no voters: 9b091bf2bbc547978432dfe2dbc1ffcd, b874a660f9d74e30bd258ed4e690aea1
I20260429 19:54:28.160910 10895 raft_consensus.cc:3060] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Advancing to term 1
I20260429 19:54:28.161417 10908 leader_election.cc:290] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:28.161679 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046"
I20260429 19:54:28.158372 10887 raft_consensus.cc:2749] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260429 19:54:28.160238 10810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd"
I20260429 19:54:28.162925 10810 raft_consensus.cc:3060] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Advancing to term 1
I20260429 19:54:28.163889 10895 raft_consensus.cc:2749] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260429 19:54:28.163877 10907 raft_consensus.cc:515] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.164162 10895 consensus_queue.cc:1048] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 19:54:28.164525 10907 leader_election.cc:290] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 election: Requested vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:28.165369 10878 tablet_bootstrap.cc:492] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046: No bootstrap required, opened a new log
I20260429 19:54:28.165376 10808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:28.165539 10878 ts_tablet_manager.cc:1403] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046: Time spent bootstrapping tablet: real 0.074s user 0.016s sys 0.034s
I20260429 19:54:28.165877 10810 raft_consensus.cc:2468] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b874a660f9d74e30bd258ed4e690aea1 in term 1.
I20260429 19:54:28.166467 10878 raft_consensus.cc:359] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.166666 10878 raft_consensus.cc:385] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:54:28.166769 10878 raft_consensus.cc:740] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5db99103528644b2b88c22cbd1a26046, State: Initialized, Role: FOLLOWER
I20260429 19:54:28.166849 10678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d4a1fea40d4f60866e5c4e8d75c743" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046"
I20260429 19:54:28.167060 10678 raft_consensus.cc:3060] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Advancing to term 1
I20260429 19:54:28.167068 10810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d4a1fea40d4f60866e5c4e8d75c743" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd"
I20260429 19:54:28.167018 10878 consensus_queue.cc:260] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.167255 10810 raft_consensus.cc:3060] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Advancing to term 1
I20260429 19:54:28.167587 10878 ts_tablet_manager.cc:1434] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260429 19:54:28.170284 10810 raft_consensus.cc:2468] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b874a660f9d74e30bd258ed4e690aea1 in term 1.
I20260429 19:54:28.171096 10906 raft_consensus.cc:515] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.171283 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:28.171545 10547 raft_consensus.cc:2393] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b091bf2bbc547978432dfe2dbc1ffcd in current term 1: Already voted for candidate b874a660f9d74e30bd258ed4e690aea1 in this term.
I20260429 19:54:28.172376 10483 leader_election.cc:304] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:28.172873 10483 leader_election.cc:304] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b091bf2bbc547978432dfe2dbc1ffcd, b874a660f9d74e30bd258ed4e690aea1; no voters:
I20260429 19:54:28.173141 10483 leader_election.cc:304] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b091bf2bbc547978432dfe2dbc1ffcd, b874a660f9d74e30bd258ed4e690aea1; no voters:
I20260429 19:54:28.173388 10908 raft_consensus.cc:2749] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 19:54:28.173586 10908 raft_consensus.cc:2804] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 19:54:28.173705 10908 raft_consensus.cc:697] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 1 LEADER]: Becoming Leader. State: Replica: b874a660f9d74e30bd258ed4e690aea1, State: Running, Role: LEADER
I20260429 19:54:28.173727 10746 leader_election.cc:304] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b091bf2bbc547978432dfe2dbc1ffcd; no voters: 5db99103528644b2b88c22cbd1a26046, b874a660f9d74e30bd258ed4e690aea1
I20260429 19:54:28.174048 10908 consensus_queue.cc:237] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.174603 10887 raft_consensus.cc:3060] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 0 FOLLOWER]: Advancing to term 1
I20260429 19:54:28.175367 10885 raft_consensus.cc:2804] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 19:54:28.175536 10885 raft_consensus.cc:697] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [term 1 LEADER]: Becoming Leader. State: Replica: b874a660f9d74e30bd258ed4e690aea1, State: Running, Role: LEADER
I20260429 19:54:28.175824 10885 consensus_queue.cc:237] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.181102 10680 raft_consensus.cc:2468] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b874a660f9d74e30bd258ed4e690aea1 in term 1.
I20260429 19:54:28.182605 10906 leader_election.cc:290] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 election: Requested vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:28.170317 10678 raft_consensus.cc:2468] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b874a660f9d74e30bd258ed4e690aea1 in term 1.
I20260429 19:54:28.184556 10808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd"
I20260429 19:54:28.187896 10887 raft_consensus.cc:2749] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260429 19:54:28.191017 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046"
I20260429 19:54:28.191236 10680 raft_consensus.cc:3060] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [term 0 FOLLOWER]: Advancing to term 1
I20260429 19:54:28.191279 10808 raft_consensus.cc:2468] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b874a660f9d74e30bd258ed4e690aea1 in term 1.
I20260429 19:54:28.192240 10483 leader_election.cc:304] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b091bf2bbc547978432dfe2dbc1ffcd, b874a660f9d74e30bd258ed4e690aea1; no voters:
I20260429 19:54:28.192610 10907 raft_consensus.cc:2804] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 19:54:28.192776 10907 raft_consensus.cc:697] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 1 LEADER]: Becoming Leader. State: Replica: b874a660f9d74e30bd258ed4e690aea1, State: Running, Role: LEADER
I20260429 19:54:28.193084 10907 consensus_queue.cc:237] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:28.193575 10680 raft_consensus.cc:2468] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b874a660f9d74e30bd258ed4e690aea1 in term 1.
I20260429 19:54:28.203871 10406 catalog_manager.cc:5671] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65). New cstate: current_term: 1 leader_uuid: "b874a660f9d74e30bd258ed4e690aea1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } health_report { overall_health: UNKNOWN } } }
I20260429 19:54:28.204535 10406 catalog_manager.cc:5671] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65). New cstate: current_term: 1 leader_uuid: "b874a660f9d74e30bd258ed4e690aea1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } health_report { overall_health: UNKNOWN } } }
I20260429 19:54:28.204864 10406 catalog_manager.cc:5671] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65). New cstate: current_term: 1 leader_uuid: "b874a660f9d74e30bd258ed4e690aea1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } health_report { overall_health: UNKNOWN } } }
I20260429 19:54:28.220561 10885 consensus_queue.cc:1048] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 19:54:28.221642 10885 consensus_queue.cc:1048] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 19:54:28.238641 10918 consensus_queue.cc:1048] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 19:54:28.243454 10884 consensus_queue.cc:1048] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 19:54:28.257480 10907 consensus_queue.cc:1048] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 19:54:28.266140 10908 consensus_queue.cc:1048] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 19:54:28.274753 10906 consensus_queue.cc:1048] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 19:54:28.280634 10906 consensus_queue.cc:1048] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 19:54:28.283236 10885 consensus_queue.cc:1048] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 19:54:28.288285 10885 consensus_queue.cc:1048] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 19:54:28.292827 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.32.68:0
--local_ip_for_outbound_sockets=127.10.32.68
--webserver_interface=127.10.32.68
--webserver_port=0
--tserver_master_addrs=127.10.32.126:41131
--builtin_ntp_servers=127.10.32.84:40097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
W20260429 19:54:28.529078 10616 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.32.65:42197, user_credentials={real_user=slave}} blocked reactor thread for 112510us
W20260429 19:54:29.054490 10940 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:54:29.055078 10940 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:54:29.055297 10940 flags.cc:432] Enabled unsafe flag: --enable_log_gc=false
W20260429 19:54:29.055470 10940 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:54:29.068450 10940 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:54:29.068816 10940 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.32.68
I20260429 19:54:29.083828 10940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.32.68:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.10.32.68
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.10.32.126:41131
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.32.68
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:54:29.086301 10940 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:54:29.089079 10940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260429 19:54:29.094906 10940 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260429 19:54:29.118582 10972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:54:29.125569 10973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:54:29.169503 10940 server_base.cc:1061] running on GCE node
W20260429 19:54:29.169967 10975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:54:29.176714 10940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 19:54:29.219087 10940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:54:29.228065 10940 hybrid_clock.cc:648] HybridClock initialized: now 1777492469227940 us; error 90 us; skew 500 ppm
I20260429 19:54:29.228718 10940 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:54:29.243279 10940 webserver.cc:492] Webserver started at http://127.10.32.68:34529/ using document root <none> and password file <none>
I20260429 19:54:29.254714 10940 fs_manager.cc:362] Metadata directory not provided
I20260429 19:54:29.255026 10940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 19:54:29.255666 10940 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260429 19:54:29.273701 10940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-3/data/instance:
uuid: "b35a6fb6005540cd8229f95c6f8cb3e5"
format_stamp: "Formatted at 2026-04-29 19:54:29 on dist-test-slave-hwg5"
I20260429 19:54:29.275053 10940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-3/wal/instance:
uuid: "b35a6fb6005540cd8229f95c6f8cb3e5"
format_stamp: "Formatted at 2026-04-29 19:54:29 on dist-test-slave-hwg5"
I20260429 19:54:29.446934 10940 fs_manager.cc:696] Time spent creating directory manager: real 0.171s user 0.080s sys 0.070s
I20260429 19:54:29.458094 10982 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:54:29.461632 10940 fs_manager.cc:730] Time spent opening block manager: real 0.010s user 0.000s sys 0.004s
I20260429 19:54:29.462006 10940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-3/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-3/wal
uuid: "b35a6fb6005540cd8229f95c6f8cb3e5"
format_stamp: "Formatted at 2026-04-29 19:54:29 on dist-test-slave-hwg5"
I20260429 19:54:29.462430 10940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 19:54:29.571178 10940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:54:29.572513 10940 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:54:29.573515 10940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:54:29.577533 10940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 19:54:29.589996 10940 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260429 19:54:29.590200 10940 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260429 19:54:29.590342 10940 ts_tablet_manager.cc:616] Registered 0 tablets
I20260429 19:54:29.590469 10940 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260429 19:54:31.546847 10940 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.68:39027
I20260429 19:54:31.549121 10940 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-3/data/info.pb
I20260429 19:54:31.546882 11102 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.68:39027 every 8 connection(s)
I20260429 19:54:31.556860 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 10940
I20260429 19:54:31.557088 10369 external_mini_cluster.cc:1442] Reading /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-3/wal/instance
I20260429 19:54:31.625416 11103 heartbeater.cc:344] Connected to a master server at 127.10.32.126:41131
I20260429 19:54:31.625867 11103 heartbeater.cc:461] Registering TS with master...
I20260429 19:54:31.627132 11103 heartbeater.cc:507] Master 127.10.32.126:41131 requested a full tablet report, sending...
I20260429 19:54:31.642807 10407 ts_manager.cc:194] Registered new tserver with Master: b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027)
I20260429 19:54:31.644035 10407 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.32.68:43311
I20260429 19:54:32.127420 10407 ts_manager.cc:295] Set tserver state for b874a660f9d74e30bd258ed4e690aea1 to MAINTENANCE_MODE
I20260429 19:54:32.128602 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 10467
I20260429 19:54:32.135283 10589 generic_service.cc:196] Checking for leaks (request via RPC)
I20260429 19:54:32.310621 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 10467
W20260429 19:54:32.337514 10615 connection.cc:570] server connection from 127.10.32.65:38909 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260429 19:54:32.337709 10866 meta_cache.cc:302] tablet de046e6b43a7413fa6e9a65e426f4721: replica b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197) has failed: Network error: recv got EOF from 127.10.32.65:42197 (error 108)
W20260429 19:54:32.338213 10616 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.32.65:42197 (error 108)
W20260429 19:54:32.338281 10745 connection.cc:570] server connection from 127.10.32.65:50975 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260429 19:54:32.341275 10638 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.341897 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.342921 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.343904 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.344095 10640 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.345881 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.358166 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.359884 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.361771 10640 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.363108 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.363821 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.368511 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260429 19:54:32.368800 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260429 19:54:32.372054 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.384635 10770 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.384605 10767 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.385703 10766 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.385753 10768 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.386026 10769 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.386298 10757 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.387115 10758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.387410 10765 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.387951 10759 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.388289 10764 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.388784 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.389171 10763 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.389536 10761 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.389957 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.393100 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.400265 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.403582 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.405488 10640 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.405588 10636 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.406052 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.406812 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.407912 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.410429 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.410677 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.415969 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.417322 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.417838 10761 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.418467 10763 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.418704 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.418992 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.420378 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.427223 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.427789 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.429246 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.429365 10763 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.430701 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.431355 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.431473 10763 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.431605 10761 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.432406 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.433153 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.442009 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.443424 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.443907 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.444519 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.445004 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.445737 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.450023 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.452685 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.455638 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.456588 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.456919 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.457461 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.459108 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.465252 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.468623 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.470305 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.471807 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.476763 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.479046 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.480188 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.482857 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.483847 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.484470 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.484472 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.491426 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.491434 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.494993 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.498350 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.501078 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.509083 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.511679 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.517062 10636 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.517133 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.517099 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.518721 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.519868 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.521428 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.525264 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.526880 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.528844 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.530056 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.535140 10762 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.535652 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.536098 10761 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.537241 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.547226 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.547226 10761 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.548848 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.548883 10761 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.549403 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.551573 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.551884 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.553053 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.562104 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.562104 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.566908 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.566936 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.572799 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.583931 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.586292 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.588924 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.590829 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.593564 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.595870 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.596380 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.604050 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
I20260429 19:54:32.605661 11122 raft_consensus.cc:493] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b874a660f9d74e30bd258ed4e690aea1)
I20260429 19:54:32.605849 11122 raft_consensus.cc:515] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
W20260429 19:54:32.607194 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
I20260429 19:54:32.608238 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 148 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:32.608696 11122 leader_election.cc:290] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183)
W20260429 19:54:32.608772 10746 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111)
W20260429 19:54:32.609252 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
I20260429 19:54:32.610052 10895 raft_consensus.cc:493] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b874a660f9d74e30bd258ed4e690aea1)
I20260429 19:54:32.610136 11097 raft_consensus.cc:493] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b874a660f9d74e30bd258ed4e690aea1)
I20260429 19:54:32.610244 10895 raft_consensus.cc:515] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:32.610297 11097 raft_consensus.cc:515] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:32.610853 10992 raft_consensus.cc:493] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b874a660f9d74e30bd258ed4e690aea1)
I20260429 19:54:32.610936 10895 leader_election.cc:290] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:32.610993 10992 raft_consensus.cc:515] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:32.610898 11097 leader_election.cc:290] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:32.611207 11122 raft_consensus.cc:493] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b874a660f9d74e30bd258ed4e690aea1)
I20260429 19:54:32.611400 11122 raft_consensus.cc:515] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:32.611593 10992 leader_election.cc:290] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:32.612141 11122 leader_election.cc:290] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183)
I20260429 19:54:32.612303 10978 raft_consensus.cc:493] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b874a660f9d74e30bd258ed4e690aea1)
I20260429 19:54:32.612360 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "5db99103528644b2b88c22cbd1a26046" candidate_term: 2 candidate_status { last_received { term: 1 index: 148 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:32.612449 10978 raft_consensus.cc:515] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:32.612841 10806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b920d515ed1846c2a4b44b05f05f9886" candidate_uuid: "5db99103528644b2b88c22cbd1a26046" candidate_term: 2 candidate_status { last_received { term: 1 index: 148 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:32.612985 10978 leader_election.cc:290] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
W20260429 19:54:32.613114 10616 leader_election.cc:336] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111)
W20260429 19:54:32.613415 10616 leader_election.cc:336] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111)
I20260429 19:54:32.613665 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d4a1fea40d4f60866e5c4e8d75c743" candidate_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 149 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:32.613857 10679 raft_consensus.cc:2468] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b091bf2bbc547978432dfe2dbc1ffcd in term 1.
I20260429 19:54:32.614092 10810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "5db99103528644b2b88c22cbd1a26046" candidate_term: 2 candidate_status { last_received { term: 1 index: 149 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:32.614279 10810 raft_consensus.cc:2468] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5db99103528644b2b88c22cbd1a26046 in term 1.
I20260429 19:54:32.614480 10744 leader_election.cc:304] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd; no voters:
W20260429 19:54:32.614586 10616 leader_election.cc:336] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111)
I20260429 19:54:32.614861 10614 leader_election.cc:304] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5db99103528644b2b88c22cbd1a26046; no voters: 9b091bf2bbc547978432dfe2dbc1ffcd, b874a660f9d74e30bd258ed4e690aea1
I20260429 19:54:32.615391 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d4a1fea40d4f60866e5c4e8d75c743" candidate_uuid: "5db99103528644b2b88c22cbd1a26046" candidate_term: 2 candidate_status { last_received { term: 1 index: 149 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:32.615604 10804 raft_consensus.cc:2468] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5db99103528644b2b88c22cbd1a26046 in term 1.
W20260429 19:54:32.615880 10616 leader_election.cc:336] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111)
W20260429 19:54:32.616135 10746 leader_election.cc:336] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111)
I20260429 19:54:32.616277 10746 leader_election.cc:304] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b091bf2bbc547978432dfe2dbc1ffcd; no voters: 5db99103528644b2b88c22cbd1a26046, b874a660f9d74e30bd258ed4e690aea1
I20260429 19:54:32.616696 10614 leader_election.cc:304] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd; no voters: b874a660f9d74e30bd258ed4e690aea1
W20260429 19:54:32.616995 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
I20260429 19:54:32.617311 10978 raft_consensus.cc:2749] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 19:54:32.617545 10978 raft_consensus.cc:2804] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260429 19:54:32.617622 10978 raft_consensus.cc:493] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b874a660f9d74e30bd258ed4e690aea1)
I20260429 19:54:32.617724 10978 raft_consensus.cc:3060] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Advancing to term 2
W20260429 19:54:32.617849 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
I20260429 19:54:32.618948 11127 raft_consensus.cc:493] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b874a660f9d74e30bd258ed4e690aea1)
I20260429 19:54:32.619220 10614 leader_election.cc:304] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd; no voters: b874a660f9d74e30bd258ed4e690aea1
I20260429 19:54:32.619184 11127 raft_consensus.cc:515] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:32.619537 11097 raft_consensus.cc:2804] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260429 19:54:32.619676 11097 raft_consensus.cc:493] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b874a660f9d74e30bd258ed4e690aea1)
I20260429 19:54:32.619773 11097 raft_consensus.cc:3060] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Advancing to term 2
I20260429 19:54:32.619990 11127 leader_election.cc:290] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183)
I20260429 19:54:32.620143 11127 raft_consensus.cc:2804] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260429 19:54:32.620236 11127 raft_consensus.cc:493] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Starting leader election (detected failure of leader b874a660f9d74e30bd258ed4e690aea1)
I20260429 19:54:32.620326 11127 raft_consensus.cc:3060] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Advancing to term 2
W20260429 19:54:32.620645 10746 leader_election.cc:336] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111)
W20260429 19:54:32.621397 10746 leader_election.cc:336] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111)
W20260429 19:54:32.622279 10761 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
I20260429 19:54:32.621577 11123 raft_consensus.cc:493] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b874a660f9d74e30bd258ed4e690aea1)
I20260429 19:54:32.622846 11123 raft_consensus.cc:515] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
W20260429 19:54:32.623027 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.623107 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
I20260429 19:54:32.623276 10806 raft_consensus.cc:2468] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5db99103528644b2b88c22cbd1a26046 in term 1.
I20260429 19:54:32.623413 11127 raft_consensus.cc:515] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:32.623625 11097 raft_consensus.cc:515] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:32.623838 10614 leader_election.cc:304] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd; no voters: b874a660f9d74e30bd258ed4e690aea1
I20260429 19:54:32.624012 11127 leader_election.cc:290] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 election: Requested vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183)
I20260429 19:54:32.624233 11127 raft_consensus.cc:2749] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 19:54:32.624270 10992 raft_consensus.cc:2804] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260429 19:54:32.624404 10992 raft_consensus.cc:493] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b874a660f9d74e30bd258ed4e690aea1)
I20260429 19:54:32.624504 10992 raft_consensus.cc:3060] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Advancing to term 2
I20260429 19:54:32.624886 11123 leader_election.cc:290] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183)
W20260429 19:54:32.625799 10746 leader_election.cc:336] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111)
W20260429 19:54:32.625933 10616 leader_election.cc:336] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111)
I20260429 19:54:32.626317 11097 leader_election.cc:290] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 2 election: Requested vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
W20260429 19:54:32.626662 10746 leader_election.cc:336] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111)
I20260429 19:54:32.626933 10806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d4a1fea40d4f60866e5c4e8d75c743" candidate_uuid: "5db99103528644b2b88c22cbd1a26046" candidate_term: 2 candidate_status { last_received { term: 1 index: 149 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd"
I20260429 19:54:32.627143 10806 raft_consensus.cc:2393] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5db99103528644b2b88c22cbd1a26046 in current term 2: Already voted for candidate 9b091bf2bbc547978432dfe2dbc1ffcd in this term.
I20260429 19:54:32.627211 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 148 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:32.627408 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d4a1fea40d4f60866e5c4e8d75c743" candidate_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 149 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046"
I20260429 19:54:32.627554 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b920d515ed1846c2a4b44b05f05f9886" candidate_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 148 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:32.627648 10677 raft_consensus.cc:2393] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b091bf2bbc547978432dfe2dbc1ffcd in current term 2: Already voted for candidate 5db99103528644b2b88c22cbd1a26046 in this term.
I20260429 19:54:32.627609 10614 leader_election.cc:304] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5db99103528644b2b88c22cbd1a26046; no voters: 9b091bf2bbc547978432dfe2dbc1ffcd, b874a660f9d74e30bd258ed4e690aea1
I20260429 19:54:32.627429 10679 raft_consensus.cc:2468] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b091bf2bbc547978432dfe2dbc1ffcd in term 1.
I20260429 19:54:32.627995 11097 raft_consensus.cc:2749] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260429 19:54:32.628302 10744 leader_election.cc:304] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b091bf2bbc547978432dfe2dbc1ffcd; no voters: 5db99103528644b2b88c22cbd1a26046, b874a660f9d74e30bd258ed4e690aea1
I20260429 19:54:32.628607 11122 raft_consensus.cc:2749] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260429 19:54:32.628717 10744 leader_election.cc:304] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd; no voters: b874a660f9d74e30bd258ed4e690aea1
I20260429 19:54:32.628971 11122 raft_consensus.cc:2804] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260429 19:54:32.629065 11122 raft_consensus.cc:493] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Starting leader election (detected failure of leader b874a660f9d74e30bd258ed4e690aea1)
I20260429 19:54:32.629150 11122 raft_consensus.cc:3060] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Advancing to term 2
W20260429 19:54:32.630563 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
I20260429 19:54:32.620779 10978 raft_consensus.cc:515] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
W20260429 19:54:32.631078 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
I20260429 19:54:32.631292 10978 leader_election.cc:290] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 2 election: Requested vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:32.630546 10992 raft_consensus.cc:515] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:32.631639 10680 raft_consensus.cc:2393] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b091bf2bbc547978432dfe2dbc1ffcd in current term 2: Already voted for candidate 5db99103528644b2b88c22cbd1a26046 in this term.
I20260429 19:54:32.631714 10806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "5db99103528644b2b88c22cbd1a26046" candidate_term: 2 candidate_status { last_received { term: 1 index: 149 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd"
I20260429 19:54:32.631903 10806 raft_consensus.cc:3060] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Advancing to term 2
W20260429 19:54:32.632659 10616 leader_election.cc:336] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111)
I20260429 19:54:32.632797 10992 leader_election.cc:290] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 2 election: Requested vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:32.633589 10744 leader_election.cc:304] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b091bf2bbc547978432dfe2dbc1ffcd; no voters: 5db99103528644b2b88c22cbd1a26046, b874a660f9d74e30bd258ed4e690aea1
W20260429 19:54:32.634270 10616 leader_election.cc:336] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111)
I20260429 19:54:32.634743 10806 raft_consensus.cc:2468] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5db99103528644b2b88c22cbd1a26046 in term 2.
I20260429 19:54:32.635219 10614 leader_election.cc:304] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd; no voters: b874a660f9d74e30bd258ed4e690aea1
I20260429 19:54:32.635454 10806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b920d515ed1846c2a4b44b05f05f9886" candidate_uuid: "5db99103528644b2b88c22cbd1a26046" candidate_term: 2 candidate_status { last_received { term: 1 index: 148 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd"
I20260429 19:54:32.635637 11126 raft_consensus.cc:3060] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Advancing to term 2
I20260429 19:54:32.636003 10992 raft_consensus.cc:2804] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [term 2 FOLLOWER]: Leader election won for term 2
I20260429 19:54:32.636137 10992 raft_consensus.cc:697] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [term 2 LEADER]: Becoming Leader. State: Replica: 5db99103528644b2b88c22cbd1a26046, State: Running, Role: LEADER
I20260429 19:54:32.636386 10992 consensus_queue.cc:237] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 148, Committed index: 148, Last appended: 1.149, Last appended by leader: 149, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:32.638077 11126 raft_consensus.cc:2749] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 19:54:32.638375 11122 raft_consensus.cc:515] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:32.638734 10401 catalog_manager.cc:5671] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 reported cstate change: term changed from 1 to 2, leader changed from b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65) to 5db99103528644b2b88c22cbd1a26046 (127.10.32.66). New cstate: current_term: 2 leader_uuid: "5db99103528644b2b88c22cbd1a26046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } health_report { overall_health: UNKNOWN } } }
I20260429 19:54:32.639020 11122 leader_election.cc:290] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 election: Requested vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183)
I20260429 19:54:32.640259 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 148 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046"
I20260429 19:54:32.640468 10680 raft_consensus.cc:3060] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [term 1 FOLLOWER]: Advancing to term 2
W20260429 19:54:32.640431 10746 leader_election.cc:336] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111)
I20260429 19:54:32.640722 10806 raft_consensus.cc:2468] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5db99103528644b2b88c22cbd1a26046 in term 2.
I20260429 19:54:32.641528 10614 leader_election.cc:304] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd; no voters: b874a660f9d74e30bd258ed4e690aea1
W20260429 19:54:32.641888 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
I20260429 19:54:32.643137 10680 raft_consensus.cc:2468] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b091bf2bbc547978432dfe2dbc1ffcd in term 2.
I20260429 19:54:32.643496 10992 raft_consensus.cc:2804] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [term 2 FOLLOWER]: Leader election won for term 2
I20260429 19:54:32.643556 10744 leader_election.cc:304] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd; no voters: b874a660f9d74e30bd258ed4e690aea1
I20260429 19:54:32.643669 10992 raft_consensus.cc:697] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [term 2 LEADER]: Becoming Leader. State: Replica: 5db99103528644b2b88c22cbd1a26046, State: Running, Role: LEADER
I20260429 19:54:32.643910 10992 consensus_queue.cc:237] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 148, Committed index: 148, Last appended: 1.148, Last appended by leader: 148, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:32.644623 11122 raft_consensus.cc:2804] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Leader election won for term 2
I20260429 19:54:32.644783 11122 raft_consensus.cc:697] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 LEADER]: Becoming Leader. State: Replica: 9b091bf2bbc547978432dfe2dbc1ffcd, State: Running, Role: LEADER
W20260429 19:54:32.645215 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Service unavailable: leader is not yet ready
I20260429 19:54:32.646216 11122 consensus_queue.cc:237] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 148, Committed index: 148, Last appended: 1.148, Last appended by leader: 148, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:32.649648 11103 heartbeater.cc:499] Master 127.10.32.126:41131 was elected leader, sending a full tablet report...
I20260429 19:54:32.650104 10404 catalog_manager.cc:5671] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd reported cstate change: term changed from 1 to 2, leader changed from b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65) to 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67). New cstate: current_term: 2 leader_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } health_report { overall_health: HEALTHY } } }
I20260429 19:54:32.651651 10401 catalog_manager.cc:5671] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 reported cstate change: term changed from 1 to 2, leader changed from b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65) to 5db99103528644b2b88c22cbd1a26046 (127.10.32.66). New cstate: current_term: 2 leader_uuid: "5db99103528644b2b88c22cbd1a26046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } health_report { overall_health: UNKNOWN } } }
W20260429 19:54:32.653970 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.656533 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.657681 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260429 19:54:32.658783 10806 raft_consensus.cc:1275] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Refusing update from remote peer 5db99103528644b2b88c22cbd1a26046: Log matching property violated. Preceding OpId in replica: term: 1 index: 148. Preceding OpId from leader: term: 2 index: 151. (index mismatch)
I20260429 19:54:32.659298 10978 consensus_queue.cc:1048] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 150, Last known committed idx: 148, Time since last communication: 0.000s
I20260429 19:54:32.660477 10806 raft_consensus.cc:1275] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Refusing update from remote peer 5db99103528644b2b88c22cbd1a26046: Log matching property violated. Preceding OpId in replica: term: 1 index: 148. Preceding OpId from leader: term: 2 index: 150. (index mismatch)
W20260429 19:54:32.661883 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260429 19:54:32.661998 11097 consensus_queue.cc:1048] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 149, Last known committed idx: 148, Time since last communication: 0.000s
I20260429 19:54:32.664024 11037 mvcc.cc:204] Tried to move back new op lower bound from 7280609167993954304 to 7280609167920488448. Current Snapshot: MvccSnapshot[applied={T|T < 7280609166557028352}]
W20260429 19:54:32.674839 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.676155 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
I20260429 19:54:32.679903 10680 raft_consensus.cc:1275] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [term 2 FOLLOWER]: Refusing update from remote peer 9b091bf2bbc547978432dfe2dbc1ffcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 148. Preceding OpId from leader: term: 2 index: 150. (index mismatch)
W20260429 19:54:32.680835 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260429 19:54:32.681090 11123 consensus_queue.cc:1048] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 149, Last known committed idx: 148, Time since last communication: 0.000s
W20260429 19:54:32.682796 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.707865 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.725530 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.727044 10637 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.754766 10760 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.754824 10761 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.789793 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.803346 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260429 19:54:32.811551 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.814749 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.821708 10761 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.840400 10761 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.844141 10761 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.881719 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260429 19:54:32.884548 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.905072 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.908308 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:32.916404 10761 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.937595 10761 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
W20260429 19:54:32.938861 10761 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46574: Illegal state: replica 9b091bf2bbc547978432dfe2dbc1ffcd is not leader of this config: current role FOLLOWER
I20260429 19:54:32.971689 11126 raft_consensus.cc:493] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:54:32.971900 11126 raft_consensus.cc:515] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:32.972647 11126 leader_election.cc:290] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183)
I20260429 19:54:32.973176 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d4a1fea40d4f60866e5c4e8d75c743" candidate_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" candidate_term: 3 candidate_status { last_received { term: 1 index: 149 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:32.973428 10680 raft_consensus.cc:2468] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b091bf2bbc547978432dfe2dbc1ffcd in term 2.
I20260429 19:54:32.973816 10744 leader_election.cc:304] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd; no voters:
I20260429 19:54:32.974076 11126 raft_consensus.cc:2804] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260429 19:54:32.974157 10746 leader_election.cc:336] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111)
I20260429 19:54:32.974193 11126 raft_consensus.cc:493] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 19:54:32.974380 11126 raft_consensus.cc:3060] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Advancing to term 3
I20260429 19:54:32.976364 11126 raft_consensus.cc:515] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:32.976864 11126 leader_election.cc:290] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 3 election: Requested vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183)
I20260429 19:54:32.977397 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d4a1fea40d4f60866e5c4e8d75c743" candidate_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" candidate_term: 3 candidate_status { last_received { term: 1 index: 149 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046"
I20260429 19:54:32.977629 10680 raft_consensus.cc:3060] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 2 FOLLOWER]: Advancing to term 3
W20260429 19:54:32.978153 10746 leader_election.cc:336] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111)
I20260429 19:54:32.979687 10680 raft_consensus.cc:2468] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b091bf2bbc547978432dfe2dbc1ffcd in term 3.
I20260429 19:54:32.980146 10744 leader_election.cc:304] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd; no voters: b874a660f9d74e30bd258ed4e690aea1
I20260429 19:54:32.980484 11126 raft_consensus.cc:2804] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 3 FOLLOWER]: Leader election won for term 3
I20260429 19:54:32.980643 11126 raft_consensus.cc:697] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 3 LEADER]: Becoming Leader. State: Replica: 9b091bf2bbc547978432dfe2dbc1ffcd, State: Running, Role: LEADER
I20260429 19:54:32.980921 11126 consensus_queue.cc:237] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 148, Committed index: 148, Last appended: 1.149, Last appended by leader: 149, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:32.983911 10401 catalog_manager.cc:5671] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd reported cstate change: term changed from 1 to 3, leader changed from b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65) to 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67). New cstate: current_term: 3 leader_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } health_report { overall_health: HEALTHY } } }
W20260429 19:54:32.984519 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:33.003963 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
W20260429 19:54:33.005100 10639 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40766: Illegal state: replica 5db99103528644b2b88c22cbd1a26046 is not leader of this config: current role FOLLOWER
I20260429 19:54:33.020221 10680 raft_consensus.cc:1275] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 3 FOLLOWER]: Refusing update from remote peer 9b091bf2bbc547978432dfe2dbc1ffcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 149. Preceding OpId from leader: term: 3 index: 151. (index mismatch)
I20260429 19:54:33.020810 11126 consensus_queue.cc:1048] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 150, Last known committed idx: 148, Time since last communication: 0.000s
W20260429 19:54:33.021064 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260429 19:54:33.025787 10949 mvcc.cc:204] Tried to move back new op lower bound from 7280609169484476416 to 7280609169332002816. Current Snapshot: MvccSnapshot[applied={T|T < 7280609169484476416 or (T in {7280609169484476416})}]
W20260429 19:54:33.171140 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260429 19:54:33.195641 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260429 19:54:33.206874 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260429 19:54:33.353309 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260429 19:54:33.359859 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260429 19:54:33.563855 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260429 19:54:33.681989 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260429 19:54:33.713749 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260429 19:54:33.722992 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260429 19:54:33.837162 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260429 19:54:33.873413 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260429 19:54:34.148645 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260429 19:54:34.162319 10992 consensus_queue.cc:579] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Leader has been unable to successfully communicate with peer b874a660f9d74e30bd258ed4e690aea1 for more than 2 seconds (2.046s)
W20260429 19:54:34.199102 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260429 19:54:34.223135 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260429 19:54:34.333354 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260429 19:54:34.375187 10992 consensus_queue.cc:579] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Leader has been unable to successfully communicate with peer b874a660f9d74e30bd258ed4e690aea1 for more than 2 seconds (2.073s)
W20260429 19:54:34.380055 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260429 19:54:34.388558 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260429 19:54:34.655230 11122 consensus_queue.cc:579] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [LEADER]: Leader has been unable to successfully communicate with peer b874a660f9d74e30bd258ed4e690aea1 for more than 2 seconds (2.008s)
W20260429 19:54:34.688093 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260429 19:54:34.696276 10992 consensus_queue.cc:579] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Leader has been unable to successfully communicate with peer b874a660f9d74e30bd258ed4e690aea1 for more than 2 seconds (2.059s)
W20260429 19:54:34.700953 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260429 19:54:34.715341 10992 consensus_queue.cc:579] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Leader has been unable to successfully communicate with peer b874a660f9d74e30bd258ed4e690aea1 for more than 2 seconds (2.071s)
W20260429 19:54:34.719520 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260429 19:54:34.911607 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260429 19:54:34.947476 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260429 19:54:34.966081 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260429 19:54:35.095348 11146 consensus_queue.cc:579] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [LEADER]: Leader has been unable to successfully communicate with peer b874a660f9d74e30bd258ed4e690aea1 for more than 2 seconds (2.114s)
W20260429 19:54:35.201357 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260429 19:54:35.260440 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260429 19:54:35.260609 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260429 19:54:35.417799 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260429 19:54:35.484899 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260429 19:54:35.497917 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260429 19:54:35.566066 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 10377
I20260429 19:54:35.567920 10438 generic_service.cc:196] Checking for leaks (request via RPC)
W20260429 19:54:35.797132 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260429 19:54:35.804628 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260429 19:54:35.827204 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260429 19:54:35.839928 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 10377
I20260429 19:54:35.891757 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.32.126:41131
--webserver_interface=127.10.32.126
--webserver_port=38515
--builtin_ntp_servers=127.10.32.84:40097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.32.126:41131 with env {}
W20260429 19:54:35.894428 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260429 19:54:36.038261 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260429 19:54:36.038857 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260429 19:54:36.103223 10855 heartbeater.cc:646] Failed to heartbeat to 127.10.32.126:41131 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.32.126:41131: connect: Connection refused (error 111)
W20260429 19:54:36.354727 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260429 19:54:36.418777 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260429 19:54:36.435961 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260429 19:54:36.456326 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260429 19:54:36.531093 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260429 19:54:36.661228 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260429 19:54:36.670809 11155 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:54:36.671329 11155 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:54:36.671509 11155 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:54:36.686277 11155 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260429 19:54:36.686547 11155 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:54:36.686690 11155 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260429 19:54:36.686806 11155 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260429 19:54:36.703022 11155 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.32.126:41131
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.32.126:41131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.32.126
--webserver_port=38515
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:54:36.711872 11155 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:54:36.714687 11155 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260429 19:54:36.745277 11163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:54:36.780750 11162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:54:36.806038 11155 server_base.cc:1061] running on GCE node
W20260429 19:54:36.810158 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260429 19:54:36.825205 11166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:54:36.831717 11155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
W20260429 19:54:36.842103 10725 heartbeater.cc:646] Failed to heartbeat to 127.10.32.126:41131 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.32.126:41131: connect: Connection refused (error 111)
W20260429 19:54:36.847838 11103 heartbeater.cc:646] Failed to heartbeat to 127.10.32.126:41131 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.32.126:41131: connect: Connection refused (error 111)
I20260429 19:54:36.922266 11155 hybrid_clock.cc:648] HybridClock initialized: now 1777492476922120 us; error 75 us; skew 500 ppm
I20260429 19:54:36.922904 11155 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:54:36.937825 11155 webserver.cc:492] Webserver started at http://127.10.32.126:38515/ using document root <none> and password file <none>
I20260429 19:54:36.939100 11155 fs_manager.cc:362] Metadata directory not provided
I20260429 19:54:36.939358 11155 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260429 19:54:36.952231 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260429 19:54:36.953253 11155 fs_manager.cc:714] Time spent opening directory manager: real 0.011s user 0.006s sys 0.001s
W20260429 19:54:36.954557 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260429 19:54:36.968554 11172 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:54:36.973217 11155 fs_manager.cc:730] Time spent opening block manager: real 0.016s user 0.002s sys 0.013s
I20260429 19:54:36.973563 11155 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/wal
uuid: "98be11f3a0ee40a698e46efd973288eb"
format_stamp: "Formatted at 2026-04-29 19:54:26 on dist-test-slave-hwg5"
I20260429 19:54:36.976013 11155 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260429 19:54:36.983119 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260429 19:54:37.035497 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260429 19:54:37.109957 11155 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:54:37.117982 11155 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:54:37.118496 11155 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260429 19:54:37.262998 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260429 19:54:37.324914 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260429 19:54:37.335094 11223 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.126:41131 every 8 connection(s)
I20260429 19:54:37.335505 11155 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.126:41131
I20260429 19:54:37.337911 11155 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/master-0/data/info.pb
I20260429 19:54:37.342242 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 11155
W20260429 19:54:37.353686 10616 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111) [suppressed 194 similar messages]
I20260429 19:54:37.354272 11224 sys_catalog.cc:263] Verifying existing consensus state
I20260429 19:54:37.357928 11224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb: Bootstrap starting.
I20260429 19:54:37.393461 11224 log.cc:826] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb: Log is configured to *not* fsync() on all Append() calls
W20260429 19:54:37.412330 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260429 19:54:37.423847 11224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=11 ignored=0} mutations{seen=16 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260429 19:54:37.424690 11224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb: Bootstrap complete.
I20260429 19:54:37.447101 11224 raft_consensus.cc:359] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98be11f3a0ee40a698e46efd973288eb" member_type: VOTER last_known_addr { host: "127.10.32.126" port: 41131 } }
I20260429 19:54:37.448309 11224 raft_consensus.cc:740] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98be11f3a0ee40a698e46efd973288eb, State: Initialized, Role: FOLLOWER
I20260429 19:54:37.449321 11224 consensus_queue.cc:260] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 1.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98be11f3a0ee40a698e46efd973288eb" member_type: VOTER last_known_addr { host: "127.10.32.126" port: 41131 } }
I20260429 19:54:37.449716 11224 raft_consensus.cc:399] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260429 19:54:37.449923 11224 raft_consensus.cc:493] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260429 19:54:37.450191 11224 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [term 1 FOLLOWER]: Advancing to term 2
I20260429 19:54:37.459403 11224 raft_consensus.cc:515] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98be11f3a0ee40a698e46efd973288eb" member_type: VOTER last_known_addr { host: "127.10.32.126" port: 41131 } }
I20260429 19:54:37.460395 11224 leader_election.cc:304] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 98be11f3a0ee40a698e46efd973288eb; no voters:
I20260429 19:54:37.471472 11224 leader_election.cc:290] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [CANDIDATE]: Term 2 election: Requested vote from peers
I20260429 19:54:37.471472 11228 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [term 2 FOLLOWER]: Leader election won for term 2
W20260429 19:54:37.488663 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260429 19:54:37.493914 11224 sys_catalog.cc:565] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [sys.catalog]: configured and running, proceeding with master startup.
I20260429 19:54:37.495510 11228 raft_consensus.cc:697] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [term 2 LEADER]: Becoming Leader. State: Replica: 98be11f3a0ee40a698e46efd973288eb, State: Running, Role: LEADER
I20260429 19:54:37.496526 11228 consensus_queue.cc:237] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 1.15, Last appended by leader: 15, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98be11f3a0ee40a698e46efd973288eb" member_type: VOTER last_known_addr { host: "127.10.32.126" port: 41131 } }
I20260429 19:54:37.501180 11229 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "98be11f3a0ee40a698e46efd973288eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98be11f3a0ee40a698e46efd973288eb" member_type: VOTER last_known_addr { host: "127.10.32.126" port: 41131 } } }
I20260429 19:54:37.505374 11229 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [sys.catalog]: This master's current role is: LEADER
I20260429 19:54:37.504961 11230 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 98be11f3a0ee40a698e46efd973288eb. Latest consensus state: current_term: 2 leader_uuid: "98be11f3a0ee40a698e46efd973288eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98be11f3a0ee40a698e46efd973288eb" member_type: VOTER last_known_addr { host: "127.10.32.126" port: 41131 } } }
I20260429 19:54:37.506011 11230 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb [sys.catalog]: This master's current role is: LEADER
W20260429 19:54:37.549335 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260429 19:54:37.550364 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260429 19:54:37.562691 11233 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260429 19:54:37.598345 11233 catalog_manager.cc:679] Loaded metadata for table test-workload [id=8634708f79084c0190cff88f97e37d71]
I20260429 19:54:37.603876 11233 tablet_loader.cc:96] loaded metadata for tablet 3449d2f7451d4a758233c5a1372a2960 (table test-workload [id=8634708f79084c0190cff88f97e37d71])
I20260429 19:54:37.604682 11233 tablet_loader.cc:96] loaded metadata for tablet 815a20bb06ab452d8dcf0ca2592b5f5d (table test-workload [id=8634708f79084c0190cff88f97e37d71])
I20260429 19:54:37.605295 11233 tablet_loader.cc:96] loaded metadata for tablet 94d4a1fea40d4f60866e5c4e8d75c743 (table test-workload [id=8634708f79084c0190cff88f97e37d71])
I20260429 19:54:37.606264 11233 tablet_loader.cc:96] loaded metadata for tablet b920d515ed1846c2a4b44b05f05f9886 (table test-workload [id=8634708f79084c0190cff88f97e37d71])
I20260429 19:54:37.608372 11233 tablet_loader.cc:96] loaded metadata for tablet de046e6b43a7413fa6e9a65e426f4721 (table test-workload [id=8634708f79084c0190cff88f97e37d71])
I20260429 19:54:37.608986 11233 tablet_loader.cc:96] loaded metadata for tablet f841352e6f584a97a0f2801c9d8651a7 (table test-workload [id=8634708f79084c0190cff88f97e37d71])
I20260429 19:54:37.609622 11233 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260429 19:54:37.612699 11233 catalog_manager.cc:1269] Loaded cluster ID: 0a135f9448584901bc187853f1f977b8
I20260429 19:54:37.612929 11233 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260429 19:54:37.633807 11233 catalog_manager.cc:1514] Loading token signing keys...
I20260429 19:54:37.648972 11233 catalog_manager.cc:6055] T 00000000000000000000000000000000 P 98be11f3a0ee40a698e46efd973288eb: Loaded TSK: 0
I20260429 19:54:37.660259 11233 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260429 19:54:37.701357 11245 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260429 19:54:37.708961 10746 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111) [suppressed 93 similar messages]
W20260429 19:54:37.861464 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260429 19:54:37.897502 10725 heartbeater.cc:344] Connected to a master server at 127.10.32.126:41131
I20260429 19:54:37.905755 11189 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "5db99103528644b2b88c22cbd1a26046" instance_seqno: 1777492467305901) as {username='slave'} at 127.10.32.66:50631; Asking this server to re-register.
I20260429 19:54:37.907013 10725 heartbeater.cc:461] Registering TS with master...
I20260429 19:54:37.907294 10725 heartbeater.cc:507] Master 127.10.32.126:41131 requested a full tablet report, sending...
I20260429 19:54:37.915566 11189 ts_manager.cc:194] Registered new tserver with Master: 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183)
I20260429 19:54:37.918164 11103 heartbeater.cc:344] Connected to a master server at 127.10.32.126:41131
I20260429 19:54:37.919515 11188 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" instance_seqno: 1777492471198327) as {username='slave'} at 127.10.32.68:56805; Asking this server to re-register.
I20260429 19:54:37.931665 11103 heartbeater.cc:461] Registering TS with master...
I20260429 19:54:37.931972 11103 heartbeater.cc:507] Master 127.10.32.126:41131 requested a full tablet report, sending...
I20260429 19:54:37.933174 11189 ts_manager.cc:194] Registered new tserver with Master: b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027)
W20260429 19:54:37.949944 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260429 19:54:38.073678 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260429 19:54:38.077366 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260429 19:54:38.117484 10855 heartbeater.cc:344] Connected to a master server at 127.10.32.126:41131
I20260429 19:54:38.119598 11189 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" instance_seqno: 1777492467773635) as {username='slave'} at 127.10.32.67:36665; Asking this server to re-register.
I20260429 19:54:38.120784 10855 heartbeater.cc:461] Registering TS with master...
I20260429 19:54:38.121052 10855 heartbeater.cc:507] Master 127.10.32.126:41131 requested a full tablet report, sending...
I20260429 19:54:38.123584 11189 ts_manager.cc:194] Registered new tserver with Master: 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
W20260429 19:54:38.397540 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260429 19:54:38.630080 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260429 19:54:38.912046 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260429 19:54:39.160728 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260429 19:54:39.160907 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260429 19:54:39.197250 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260429 19:54:39.371212 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260429 19:54:39.433324 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260429 19:54:39.503463 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260429 19:54:39.565629 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260429 19:54:39.680742 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260429 19:54:39.704360 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260429 19:54:39.904696 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260429 19:54:39.991572 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260429 19:54:40.052647 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260429 19:54:40.106940 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260429 19:54:40.239168 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260429 19:54:40.246083 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260429 19:54:40.420805 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260429 19:54:40.485700 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260429 19:54:40.517067 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.32.65:42197
--local_ip_for_outbound_sockets=127.10.32.65
--tserver_master_addrs=127.10.32.126:41131
--webserver_port=38009
--webserver_interface=127.10.32.65
--builtin_ntp_servers=127.10.32.84:40097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
W20260429 19:54:40.669963 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260429 19:54:40.783432 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260429 19:54:40.784158 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260429 19:54:40.890072 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260429 19:54:40.929303 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260429 19:54:41.044473 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260429 19:54:41.192700 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260429 19:54:41.363936 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260429 19:54:41.366338 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260429 19:54:41.427841 11259 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:54:41.428375 11259 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:54:41.428535 11259 flags.cc:432] Enabled unsafe flag: --enable_log_gc=false
W20260429 19:54:41.428707 11259 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:54:41.442824 11259 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:54:41.443188 11259 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.32.65
I20260429 19:54:41.460073 11259 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.32.65:42197
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.32.65
--webserver_port=38009
--enable_log_gc=false
--tserver_master_addrs=127.10.32.126:41131
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.32.65
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:54:41.462584 11259 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:54:41.465583 11259 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260429 19:54:41.470275 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
E20260429 19:54:41.472249 11259 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260429 19:54:41.484237 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260429 19:54:41.596731 11266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:54:41.598644 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260429 19:54:41.653481 11265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:54:41.735852 11269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:54:41.742190 11259 server_base.cc:1061] running on GCE node
I20260429 19:54:41.745105 11259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
W20260429 19:54:41.766610 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
I20260429 19:54:41.804179 11259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:54:41.806264 11259 hybrid_clock.cc:648] HybridClock initialized: now 1777492481806056 us; error 207 us; skew 500 ppm
I20260429 19:54:41.806926 11259 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:54:41.922302 11259 webserver.cc:492] Webserver started at http://127.10.32.65:38009/ using document root <none> and password file <none>
I20260429 19:54:41.925125 11259 fs_manager.cc:362] Metadata directory not provided
I20260429 19:54:41.925387 11259 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 19:54:41.951702 11259 fs_manager.cc:714] Time spent opening directory manager: real 0.023s user 0.011s sys 0.005s
W20260429 19:54:41.952265 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
I20260429 19:54:41.971792 11274 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:54:41.974680 11259 fs_manager.cc:730] Time spent opening block manager: real 0.020s user 0.004s sys 0.003s
I20260429 19:54:41.975005 11259 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/wal
uuid: "b874a660f9d74e30bd258ed4e690aea1"
format_stamp: "Formatted at 2026-04-29 19:54:26 on dist-test-slave-hwg5"
I20260429 19:54:41.976473 11259 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260429 19:54:41.993438 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260429 19:54:41.994277 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260429 19:54:42.007414 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260429 19:54:42.101897 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
I20260429 19:54:42.218874 11259 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:54:42.220053 11259 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:54:42.220412 11259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:54:42.238479 11259 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 19:54:42.276873 11282 ts_tablet_manager.cc:548] Loading tablet metadata (0/6 complete)
I20260429 19:54:42.316573 11259 ts_tablet_manager.cc:585] Loaded tablet metadata (6 total tablets, 6 live tablets)
I20260429 19:54:42.316704 11259 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.058s user 0.002s sys 0.003s
I20260429 19:54:42.316854 11259 ts_tablet_manager.cc:600] Registering tablets (0/6 complete)
I20260429 19:54:42.341894 11282 tablet_bootstrap.cc:492] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1: Bootstrap starting.
W20260429 19:54:42.368181 10616 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111) [suppressed 146 similar messages]
W20260429 19:54:42.386910 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
I20260429 19:54:42.391417 11259 ts_tablet_manager.cc:616] Registered 6 tablets
I20260429 19:54:42.395071 11259 ts_tablet_manager.cc:595] Time spent register tablets: real 0.078s user 0.005s sys 0.013s
I20260429 19:54:42.449668 11282 log.cc:826] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1: Log is configured to *not* fsync() on all Append() calls
W20260429 19:54:42.499951 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260429 19:54:42.579777 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260429 19:54:42.602278 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260429 19:54:42.603372 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260429 19:54:42.676200 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260429 19:54:42.710294 10746 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111) [suppressed 87 similar messages]
I20260429 19:54:42.788064 11282 tablet_bootstrap.cc:492] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1: Bootstrap replayed 1/1 log segments. Stats: ops{read=148 overwritten=0 applied=146 ignored=0} inserts{seen=1149 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260429 19:54:42.789254 11282 tablet_bootstrap.cc:492] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1: Bootstrap complete.
I20260429 19:54:42.791220 11282 ts_tablet_manager.cc:1403] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1: Time spent bootstrapping tablet: real 0.450s user 0.250s sys 0.046s
I20260429 19:54:42.800076 11282 raft_consensus.cc:359] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:42.828728 11282 raft_consensus.cc:740] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b874a660f9d74e30bd258ed4e690aea1, State: Initialized, Role: FOLLOWER
I20260429 19:54:42.830021 11282 consensus_queue.cc:260] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 146, Last appended: 1.148, Last appended by leader: 148, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:42.835574 11282 ts_tablet_manager.cc:1434] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1: Time spent starting tablet: real 0.044s user 0.022s sys 0.001s
I20260429 19:54:42.836293 11282 tablet_bootstrap.cc:492] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1: Bootstrap starting.
W20260429 19:54:43.040390 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
I20260429 19:54:43.075708 11312 raft_consensus.cc:493] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:54:43.076000 11312 raft_consensus.cc:515] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:43.080384 11312 leader_election.cc:290] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:43.128860 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 148 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:43.153468 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 148 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:43.154670 11276 leader_election.cc:304] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:43.155875 11312 raft_consensus.cc:2749] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260429 19:54:43.168162 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260429 19:54:43.170923 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260429 19:54:43.186956 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260429 19:54:43.224305 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260429 19:54:43.245990 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20260429 19:54:43.428810 10938 meta_cache.cc:1261] Time spent looking up entry by key: real 0.063s user 0.000s sys 0.000s
I20260429 19:54:43.543550 11312 raft_consensus.cc:493] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:54:43.543748 11312 raft_consensus.cc:515] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:43.544556 11312 leader_election.cc:290] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:43.545606 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 148 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:43.576984 11282 tablet_bootstrap.cc:492] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1: Bootstrap replayed 1/1 log segments. Stats: ops{read=149 overwritten=0 applied=148 ignored=0} inserts{seen=1218 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260429 19:54:43.580716 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 148 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:43.586465 11276 leader_election.cc:304] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
W20260429 19:54:43.595642 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
I20260429 19:54:43.596750 11312 raft_consensus.cc:2749] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 19:54:43.601526 11282 tablet_bootstrap.cc:492] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1: Bootstrap complete.
I20260429 19:54:43.604230 11282 ts_tablet_manager.cc:1403] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1: Time spent bootstrapping tablet: real 0.768s user 0.270s sys 0.034s
I20260429 19:54:43.605334 11282 raft_consensus.cc:359] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:43.614446 11282 raft_consensus.cc:740] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b874a660f9d74e30bd258ed4e690aea1, State: Initialized, Role: FOLLOWER
I20260429 19:54:43.614849 11282 consensus_queue.cc:260] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 148, Last appended: 1.149, Last appended by leader: 149, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:43.615465 11282 ts_tablet_manager.cc:1434] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1: Time spent starting tablet: real 0.011s user 0.005s sys 0.001s
I20260429 19:54:43.616348 11282 tablet_bootstrap.cc:492] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1: Bootstrap starting.
W20260429 19:54:43.710531 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20260429 19:54:43.714510 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260429 19:54:43.755163 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20260429 19:54:43.826186 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20260429 19:54:43.891091 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
I20260429 19:54:43.892587 11312 raft_consensus.cc:493] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:54:43.892779 11312 raft_consensus.cc:515] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:43.893483 11312 leader_election.cc:290] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:43.894367 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 149 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:43.897373 10810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 149 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:43.915297 11276 leader_election.cc:304] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:43.915807 11312 raft_consensus.cc:2749] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 19:54:44.054193 11282 tablet_bootstrap.cc:492] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1: Bootstrap replayed 1/1 log segments. Stats: ops{read=150 overwritten=0 applied=150 ignored=0} inserts{seen=1333 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260429 19:54:44.054867 11282 tablet_bootstrap.cc:492] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1: Bootstrap complete.
I20260429 19:54:44.056139 11282 ts_tablet_manager.cc:1403] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1: Time spent bootstrapping tablet: real 0.440s user 0.236s sys 0.042s
I20260429 19:54:44.057106 11282 raft_consensus.cc:359] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:44.057579 11282 raft_consensus.cc:740] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b874a660f9d74e30bd258ed4e690aea1, State: Initialized, Role: FOLLOWER
I20260429 19:54:44.066200 11282 consensus_queue.cc:260] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 150, Last appended: 1.150, Last appended by leader: 150, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:44.067058 11282 ts_tablet_manager.cc:1434] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260429 19:54:44.067461 11282 tablet_bootstrap.cc:492] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1: Bootstrap starting.
W20260429 19:54:44.107177 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
I20260429 19:54:44.258597 11312 raft_consensus.cc:493] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:54:44.258790 11312 raft_consensus.cc:515] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:44.259466 11312 leader_election.cc:290] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:44.260785 10806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 148 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:44.260777 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 148 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:44.261937 11276 leader_election.cc:304] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:44.263041 11312 raft_consensus.cc:2749] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260429 19:54:44.295205 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
I20260429 19:54:44.344923 11402 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.65:42197 every 8 connection(s)
I20260429 19:54:44.349783 11259 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.65:42197
I20260429 19:54:44.352067 11259 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777492465722499-10369-0/minicluster-data/ts-0/data/info.pb
I20260429 19:54:44.354533 11312 raft_consensus.cc:493] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:54:44.354746 11312 raft_consensus.cc:515] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:44.355463 11312 leader_election.cc:290] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:44.356741 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 149 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:44.356760 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 149 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:44.359068 11276 leader_election.cc:304] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:44.360360 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 11259
I20260429 19:54:44.368775 11312 raft_consensus.cc:2749] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 19:54:44.455677 11312 raft_consensus.cc:493] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:54:44.483562 11404 heartbeater.cc:344] Connected to a master server at 127.10.32.126:41131
I20260429 19:54:44.484606 11312 raft_consensus.cc:515] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:44.484879 11404 heartbeater.cc:461] Registering TS with master...
I20260429 19:54:44.485350 11312 leader_election.cc:290] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:44.486292 11404 heartbeater.cc:507] Master 127.10.32.126:41131 requested a full tablet report, sending...
I20260429 19:54:44.493770 11189 ts_manager.cc:194] Registered new tserver with Master: b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197)
I20260429 19:54:44.499768 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 150 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:44.499984 11189 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.32.65:53025
I20260429 19:54:44.504915 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 150 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:44.510547 11276 leader_election.cc:304] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:44.511173 11312 raft_consensus.cc:2749] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260429 19:54:44.652412 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 101: this message will repeat every 5th retry.
I20260429 19:54:44.678084 11353 raft_consensus.cc:3060] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Advancing to term 2
I20260429 19:54:44.699074 11348 raft_consensus.cc:3060] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Advancing to term 2
I20260429 19:54:44.733304 11404 heartbeater.cc:499] Master 127.10.32.126:41131 was elected leader, sending a full tablet report...
W20260429 19:54:44.772372 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 101: this message will repeat every 5th retry.
W20260429 19:54:44.930559 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 96: this message will repeat every 5th retry.
I20260429 19:54:45.107452 11282 tablet_bootstrap.cc:492] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1: Bootstrap replayed 1/1 log segments. Stats: ops{read=150 overwritten=0 applied=148 ignored=0} inserts{seen=1181 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260429 19:54:45.111891 11282 tablet_bootstrap.cc:492] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1: Bootstrap complete.
I20260429 19:54:45.131716 11282 ts_tablet_manager.cc:1403] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1: Time spent bootstrapping tablet: real 1.046s user 0.267s sys 0.022s
I20260429 19:54:45.170372 11282 raft_consensus.cc:359] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:45.209360 11282 raft_consensus.cc:740] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b874a660f9d74e30bd258ed4e690aea1, State: Initialized, Role: FOLLOWER
I20260429 19:54:45.228683 11282 consensus_queue.cc:260] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 148, Last appended: 1.150, Last appended by leader: 150, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:45.233366 11282 ts_tablet_manager.cc:1434] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1: Time spent starting tablet: real 0.099s user 0.002s sys 0.009s
I20260429 19:54:45.233793 11282 tablet_bootstrap.cc:492] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1: Bootstrap starting.
I20260429 19:54:45.438913 11351 raft_consensus.cc:3060] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Advancing to term 2
I20260429 19:54:45.478356 11351 pending_rounds.cc:85] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1: Aborting all ops after (but not including) 148
I20260429 19:54:45.494988 11351 pending_rounds.cc:107] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1: Aborting uncommitted WRITE_OP operation due to leader change: 1.149
I20260429 19:54:45.495646 11351 pending_rounds.cc:107] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1: Aborting uncommitted WRITE_OP operation due to leader change: 1.150
W20260429 19:54:45.843446 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 106: this message will repeat every 5th retry.
W20260429 19:54:45.882588 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 106: this message will repeat every 5th retry.
W20260429 19:54:46.308760 11282 log.cc:927] Time spent T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1: Append to log took a long time: real 0.082s user 0.001s sys 0.003s
W20260429 19:54:46.386742 11282 log.cc:927] Time spent T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1: Append to log took a long time: real 0.073s user 0.003s sys 0.000s
I20260429 19:54:46.460403 11312 raft_consensus.cc:493] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:46.460608 11312 raft_consensus.cc:515] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:46.461583 11312 leader_election.cc:290] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:46.462234 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 766 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:46.462328 10810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 766 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:46.463060 11276 leader_election.cc:304] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:46.463573 11312 raft_consensus.cc:2749] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260429 19:54:46.478529 11348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.32.66:59965 (request call id 3) took 1989 ms. Trace:
I20260429 19:54:46.617607 11412 raft_consensus.cc:493] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:46.630789 11412 raft_consensus.cc:515] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:46.636799 11350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.32.66:59965 (request call id 1) took 2137 ms. Trace:
I20260429 19:54:46.638731 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 762 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:46.643756 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 762 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:46.644431 11276 leader_election.cc:304] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:46.649770 11412 leader_election.cc:290] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:46.664721 11312 raft_consensus.cc:2749] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 19:54:46.778558 11353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.32.67:35721 (request call id 0) took 2322 ms. Trace:
I20260429 19:54:46.795353 11411 raft_consensus.cc:493] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b091bf2bbc547978432dfe2dbc1ffcd)
I20260429 19:54:46.819609 11411 raft_consensus.cc:515] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:46.825369 11412 raft_consensus.cc:493] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:46.819654 11305 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:59566 (request call id 0) took 2174 ms. Trace:
I20260429 19:54:46.827697 11412 raft_consensus.cc:515] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:46.828433 11412 leader_election.cc:290] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:46.829581 10809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 766 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:46.834244 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 766 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:46.837960 11411 leader_election.cc:290] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:46.839367 10809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 754 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:46.845774 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 754 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:46.843158 11305 rpcz_store.cc:276] 0429 19:54:44.612556 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 19:54:44.612612 (+ 56us) service_pool.cc:225] Handling call
0429 19:54:46.778605 (+2165993us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x616000018a54. stack: 00007faa35dc9086 00007faa35dc8e40 00007faa34d823ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007faa41cb78c0 00007faa45b72eaf 00007faa3ff8ac36 00007faa3ff8a965 00007faa3cd9a65e 00007faa3cd9953e 00007faa3cd9f738 00007faa3cda009f 00007faa3cd9fec8 0000000000aa4cac
0429 19:54:46.787214 (+ 8609us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4962818304}
I20260429 19:54:46.881392 11276 leader_election.cc:304] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:46.882028 11276 leader_election.cc:304] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:46.894104 11411 raft_consensus.cc:2749] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260429 19:54:46.901712 11412 raft_consensus.cc:2749] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260429 19:54:46.935999 11413 raft_consensus.cc:493] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:46.936229 11413 raft_consensus.cc:515] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:46.945465 11413 leader_election.cc:290] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:46.950476 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b920d515ed1846c2a4b44b05f05f9886" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 796 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:46.970566 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b920d515ed1846c2a4b44b05f05f9886" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 796 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:46.972843 11351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.32.66:59965 (request call id 7) took 1838 ms. Trace:
I20260429 19:54:46.979411 11276 leader_election.cc:304] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:46.979765 11413 raft_consensus.cc:2749] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260429 19:54:46.992010 11413 raft_consensus.cc:493] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:46.992319 11413 raft_consensus.cc:515] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:46.992988 11413 leader_election.cc:290] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:47.002465 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 762 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:47.007529 10806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 762 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:47.016886 11276 leader_election.cc:304] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:47.037451 11413 raft_consensus.cc:2749] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 19:54:47.303819 11413 raft_consensus.cc:493] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:47.304018 11413 raft_consensus.cc:515] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:47.322417 11412 raft_consensus.cc:493] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b091bf2bbc547978432dfe2dbc1ffcd)
I20260429 19:54:47.323573 11412 raft_consensus.cc:515] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:47.324342 11412 leader_election.cc:290] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:47.325296 10809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 754 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:47.325579 10806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 766 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:47.331037 11413 leader_election.cc:290] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:47.337927 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 766 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:47.338518 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 754 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:47.354288 11276 leader_election.cc:304] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:47.354624 11413 raft_consensus.cc:2749] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260429 19:54:47.354851 11276 leader_election.cc:304] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:47.357074 11413 raft_consensus.cc:2749] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260429 19:54:47.392182 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 111: this message will repeat every 5th retry.
I20260429 19:54:47.422236 11413 raft_consensus.cc:493] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:47.424521 11413 raft_consensus.cc:515] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:47.425621 11413 leader_election.cc:290] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:47.426185 10806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b920d515ed1846c2a4b44b05f05f9886" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 796 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:47.427273 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b920d515ed1846c2a4b44b05f05f9886" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 796 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:47.431650 11276 leader_election.cc:304] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:47.438738 11413 raft_consensus.cc:2749] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260429 19:54:47.513036 11413 raft_consensus.cc:493] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:47.514938 11413 raft_consensus.cc:515] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:47.517452 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 762 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:47.524410 10809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 762 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:47.530234 11276 leader_election.cc:304] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:47.535954 11413 leader_election.cc:290] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:47.549494 11412 raft_consensus.cc:2749] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 19:54:47.668104 11419 mvcc.cc:204] Tried to move back new op lower bound from 7280609214658277376 to 7280609167962599424. Current Snapshot: MvccSnapshot[applied={T|T < 7280609168089804800}]
I20260429 19:54:47.743767 11412 raft_consensus.cc:493] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b091bf2bbc547978432dfe2dbc1ffcd)
I20260429 19:54:47.747205 11412 raft_consensus.cc:515] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:47.747968 11412 leader_election.cc:290] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:47.748908 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 754 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:47.748879 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 754 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:47.752203 11276 leader_election.cc:304] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:47.752801 11412 raft_consensus.cc:2749] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260429 19:54:47.845894 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 111: this message will repeat every 5th retry.
I20260429 19:54:47.944028 11412 raft_consensus.cc:493] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:47.961028 11412 raft_consensus.cc:515] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:47.961786 11412 leader_election.cc:290] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:47.962996 10806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b920d515ed1846c2a4b44b05f05f9886" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 796 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:47.967813 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b920d515ed1846c2a4b44b05f05f9886" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 796 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:47.980949 11276 leader_election.cc:304] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:47.981868 11412 raft_consensus.cc:2749] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260429 19:54:48.149247 11412 raft_consensus.cc:493] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:48.159516 11412 raft_consensus.cc:515] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:48.165135 10809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 762 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:48.167029 11412 leader_election.cc:290] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:48.171483 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 762 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:48.172703 11276 leader_election.cc:304] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:48.173975 11412 raft_consensus.cc:2749] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 19:54:48.268639 11412 raft_consensus.cc:493] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:48.268864 11412 raft_consensus.cc:515] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:48.269690 11412 leader_election.cc:290] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:48.270926 10806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 766 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:48.275158 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 766 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:48.282111 11276 leader_election.cc:304] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:48.283581 11412 raft_consensus.cc:2749] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260429 19:54:48.654901 11412 raft_consensus.cc:493] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:48.656490 11412 raft_consensus.cc:515] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:48.657186 11412 leader_election.cc:290] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:48.657977 10810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 766 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:48.659248 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 766 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:48.660087 11276 leader_election.cc:304] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:48.660635 11412 raft_consensus.cc:2749] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260429 19:54:48.767508 11412 raft_consensus.cc:493] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b091bf2bbc547978432dfe2dbc1ffcd)
I20260429 19:54:48.774137 11412 raft_consensus.cc:515] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:48.774914 11412 leader_election.cc:290] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:48.775708 10809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 754 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:48.790838 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 754 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:48.791532 11276 leader_election.cc:304] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:48.807113 11412 raft_consensus.cc:2749] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260429 19:54:48.844465 11412 raft_consensus.cc:493] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:48.846701 11412 raft_consensus.cc:515] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:48.847494 11412 leader_election.cc:290] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:48.847883 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 762 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:48.848457 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 762 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:48.861234 11276 leader_election.cc:304] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:48.865990 11412 raft_consensus.cc:2749] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 19:54:48.884586 11282 tablet_bootstrap.cc:492] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1: Bootstrap replayed 1/1 log segments. Stats: ops{read=149 overwritten=0 applied=148 ignored=0} inserts{seen=1215 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260429 19:54:48.899748 11282 tablet_bootstrap.cc:492] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1: Bootstrap complete.
I20260429 19:54:48.903167 11282 ts_tablet_manager.cc:1403] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1: Time spent bootstrapping tablet: real 3.668s user 0.297s sys 0.057s
I20260429 19:54:48.933053 11282 raft_consensus.cc:359] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:48.941484 11412 raft_consensus.cc:493] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:48.942890 11412 raft_consensus.cc:515] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:48.943560 11412 leader_election.cc:290] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:48.945022 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b920d515ed1846c2a4b44b05f05f9886" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 796 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:48.952075 10809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b920d515ed1846c2a4b44b05f05f9886" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 796 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:48.952744 11276 leader_election.cc:304] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:48.954046 11282 raft_consensus.cc:740] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b874a660f9d74e30bd258ed4e690aea1, State: Initialized, Role: FOLLOWER
I20260429 19:54:48.955122 11412 raft_consensus.cc:2749] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260429 19:54:48.971061 11282 consensus_queue.cc:260] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 148, Last appended: 1.149, Last appended by leader: 149, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:48.988517 11282 ts_tablet_manager.cc:1434] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1: Time spent starting tablet: real 0.083s user 0.003s sys 0.000s
I20260429 19:54:48.991518 11282 tablet_bootstrap.cc:492] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1: Bootstrap starting.
I20260429 19:54:46.981108 11351 rpcz_store.cc:276] 0429 19:54:45.074285 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 19:54:45.074619 (+ 334us) service_pool.cc:225] Handling call
0429 19:54:45.290478 (+215859us) raft_consensus.cc:1471] Updating replica for 648 ops
0429 19:54:45.495508 (+205030us) write_op.cc:489] Releasing partition, row and schema locks
0429 19:54:45.495512 (+ 4us) write_op.cc:454] Released schema lock
0429 19:54:45.496036 (+ 524us) write_op.cc:489] Releasing partition, row and schema locks
0429 19:54:45.496040 (+ 4us) write_op.cc:454] Released schema lock
0429 19:54:45.499561 (+ 3521us) raft_consensus.cc:1534] Early marking committed up to index 0
0429 19:54:45.499566 (+ 5us) raft_consensus.cc:1539] Triggering prepare for 648 ops
0429 19:54:45.503172 (+ 3606us) write_op.cc:270] Start()
0429 19:54:45.503204 (+ 32us) write_op.cc:276] Timestamp: P: 1777492472659188 usec, L: 0
0429 19:54:45.503957 (+ 753us) write_op.cc:270] Start()
0429 19:54:45.503982 (+ 25us) write_op.cc:276] Timestamp: P: 1777492472660034 usec, L: 0
0429 19:54:45.504663 (+ 681us) write_op.cc:270] Start()
0429 19:54:45.504693 (+ 30us) write_op.cc:276] Timestamp: P: 1777492472670066 usec, L: 0
0429 19:54:45.504875 (+ 182us) write_op.cc:270] Start()
0429 19:54:45.504895 (+ 20us) write_op.cc:276] Timestamp: P: 1777492472672964 usec, L: 0
0429 19:54:45.505114 (+ 219us) write_op.cc:270] Start()
0429 19:54:45.505137 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473037137 usec, L: 0
0429 19:54:45.505278 (+ 141us) write_op.cc:270] Start()
0429 19:54:45.505309 (+ 31us) write_op.cc:276] Timestamp: P: 1777492473052362 usec, L: 0
0429 19:54:45.505459 (+ 150us) write_op.cc:270] Start()
0429 19:54:45.505484 (+ 25us) write_op.cc:276] Timestamp: P: 1777492473063864 usec, L: 0
0429 19:54:45.512919 (+ 7435us) write_op.cc:270] Start()
0429 19:54:45.512950 (+ 31us) write_op.cc:276] Timestamp: P: 1777492473076237 usec, L: 0
0429 19:54:45.513168 (+ 218us) write_op.cc:270] Start()
0429 19:54:45.513218 (+ 50us) write_op.cc:276] Timestamp: P: 1777492473080236 usec, L: 0
0429 19:54:45.513389 (+ 171us) write_op.cc:270] Start()
0429 19:54:45.513409 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473105819 usec, L: 0
0429 19:54:45.513546 (+ 137us) write_op.cc:270] Start()
0429 19:54:45.513564 (+ 18us) write_op.cc:276] Timestamp: P: 1777492473131733 usec, L: 0
0429 19:54:45.515435 (+ 1871us) write_op.cc:270] Start()
0429 19:54:45.515461 (+ 26us) write_op.cc:276] Timestamp: P: 1777492473138034 usec, L: 0
0429 19:54:45.519151 (+ 3690us) write_op.cc:270] Start()
0429 19:54:45.542746 (+ 23595us) write_op.cc:276] Timestamp: P: 1777492473146864 usec, L: 0
0429 19:54:45.550500 (+ 7754us) write_op.cc:270] Start()
0429 19:54:45.550521 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473163715 usec, L: 0
0429 19:54:45.550714 (+ 193us) write_op.cc:270] Start()
0429 19:54:45.550736 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473179454 usec, L: 0
0429 19:54:45.550888 (+ 152us) write_op.cc:270] Start()
0429 19:54:45.550908 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473203346 usec, L: 0
0429 19:54:45.551092 (+ 184us) write_op.cc:270] Start()
0429 19:54:45.551123 (+ 31us) write_op.cc:276] Timestamp: P: 1777492473209183 usec, L: 0
0429 19:54:45.551303 (+ 180us) write_op.cc:270] Start()
0429 19:54:45.551328 (+ 25us) write_op.cc:276] Timestamp: P: 1777492473220908 usec, L: 0
0429 19:54:45.552321 (+ 993us) write_op.cc:270] Start()
0429 19:54:45.552351 (+ 30us) write_op.cc:276] Timestamp: P: 1777492473227158 usec, L: 0
0429 19:54:45.560437 (+ 8086us) write_op.cc:270] Start()
0429 19:54:45.560462 (+ 25us) write_op.cc:276] Timestamp: P: 1777492473263999 usec, L: 0
0429 19:54:45.563463 (+ 3001us) write_op.cc:270] Start()
0429 19:54:45.563491 (+ 28us) write_op.cc:276] Timestamp: P: 1777492473265494 usec, L: 0
0429 19:54:45.563668 (+ 177us) write_op.cc:270] Start()
0429 19:54:45.577413 (+ 13745us) write_op.cc:276] Timestamp: P: 1777492473270855 usec, L: 0
0429 19:54:45.581136 (+ 3723us) write_op.cc:270] Start()
0429 19:54:45.581161 (+ 25us) write_op.cc:276] Timestamp: P: 1777492473289594 usec, L: 0
0429 19:54:45.626757 (+ 45596us) write_op.cc:270] Start()
0429 19:54:45.626803 (+ 46us) write_op.cc:276] Timestamp: P: 1777492473327408 usec, L: 0
0429 19:54:45.627041 (+ 238us) write_op.cc:270] Start()
0429 19:54:45.627064 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473329458 usec, L: 0
0429 19:54:45.627289 (+ 225us) write_op.cc:270] Start()
0429 19:54:45.627310 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473361299 usec, L: 0
0429 19:54:45.627465 (+ 155us) write_op.cc:270] Start()
0429 19:54:45.627488 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473365502 usec, L: 0
0429 19:54:45.627658 (+ 170us) write_op.cc:270] Start()
0429 19:54:45.627678 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473382252 usec, L: 0
0429 19:54:45.627829 (+ 151us) write_op.cc:270] Start()
0429 19:54:45.627849 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473414444 usec, L: 0
0429 19:54:45.627990 (+ 141us) write_op.cc:270] Start()
0429 19:54:45.628017 (+ 27us) write_op.cc:276] Timestamp: P: 1777492473418744 usec, L: 0
0429 19:54:45.628212 (+ 195us) write_op.cc:270] Start()
0429 19:54:45.628234 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473438030 usec, L: 0
0429 19:54:45.628413 (+ 179us) write_op.cc:270] Start()
0429 19:54:45.628433 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473462510 usec, L: 0
0429 19:54:45.628640 (+ 207us) write_op.cc:270] Start()
0429 19:54:45.628665 (+ 25us) write_op.cc:276] Timestamp: P: 1777492473463825 usec, L: 0
0429 19:54:45.628819 (+ 154us) write_op.cc:270] Start()
0429 19:54:45.628839 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473478113 usec, L: 0
0429 19:54:45.628967 (+ 128us) write_op.cc:270] Start()
0429 19:54:45.628985 (+ 18us) write_op.cc:276] Timestamp: P: 1777492473480270 usec, L: 0
0429 19:54:45.629157 (+ 172us) write_op.cc:270] Start()
0429 19:54:45.629177 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473511155 usec, L: 0
0429 19:54:45.629351 (+ 174us) write_op.cc:270] Start()
0429 19:54:45.629387 (+ 36us) write_op.cc:276] Timestamp: P: 1777492473518621 usec, L: 0
0429 19:54:45.629541 (+ 154us) write_op.cc:270] Start()
0429 19:54:45.629573 (+ 32us) write_op.cc:276] Timestamp: P: 1777492473527004 usec, L: 0
0429 19:54:45.629738 (+ 165us) write_op.cc:270] Start()
0429 19:54:45.629758 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473529938 usec, L: 0
0429 19:54:45.629902 (+ 144us) write_op.cc:270] Start()
0429 19:54:45.629922 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473552308 usec, L: 0
0429 19:54:45.630085 (+ 163us) write_op.cc:270] Start()
0429 19:54:45.630105 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473565707 usec, L: 0
0429 19:54:45.630262 (+ 157us) write_op.cc:270] Start()
0429 19:54:45.630283 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473579129 usec, L: 0
0429 19:54:45.654456 (+ 24173us) write_op.cc:270] Start()
0429 19:54:45.654477 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473583852 usec, L: 0
0429 19:54:45.654621 (+ 144us) write_op.cc:270] Start()
0429 19:54:45.654641 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473598215 usec, L: 0
0429 19:54:45.654809 (+ 168us) write_op.cc:270] Start()
0429 19:54:45.654833 (+ 24us) write_op.cc:276] Timestamp: P: 1777492473610660 usec, L: 0
0429 19:54:45.654969 (+ 136us) write_op.cc:270] Start()
0429 19:54:45.654989 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473634397 usec, L: 0
0429 19:54:45.655188 (+ 199us) write_op.cc:270] Start()
0429 19:54:45.655209 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473657496 usec, L: 0
0429 19:54:45.655370 (+ 161us) write_op.cc:270] Start()
0429 19:54:45.655391 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473660634 usec, L: 0
0429 19:54:45.655567 (+ 176us) write_op.cc:270] Start()
0429 19:54:45.655588 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473676520 usec, L: 0
0429 19:54:45.655739 (+ 151us) write_op.cc:270] Start()
0429 19:54:45.655760 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473692839 usec, L: 0
0429 19:54:45.655933 (+ 173us) write_op.cc:270] Start()
0429 19:54:45.655953 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473718252 usec, L: 0
0429 19:54:45.656097 (+ 144us) write_op.cc:270] Start()
0429 19:54:45.656117 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473727970 usec, L: 0
0429 19:54:45.656269 (+ 152us) write_op.cc:270] Start()
0429 19:54:45.656291 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473729365 usec, L: 0
0429 19:54:45.656442 (+ 151us) write_op.cc:270] Start()
0429 19:54:45.656464 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473752140 usec, L: 0
0429 19:54:45.656649 (+ 185us) write_op.cc:270] Start()
0429 19:54:45.656671 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473759187 usec, L: 0
0429 19:54:45.656826 (+ 155us) write_op.cc:270] Start()
0429 19:54:45.656846 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473774214 usec, L: 0
0429 19:54:45.657023 (+ 177us) write_op.cc:270] Start()
0429 19:54:45.657044 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473791891 usec, L: 0
0429 19:54:45.657201 (+ 157us) write_op.cc:270] Start()
0429 19:54:45.657221 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473798757 usec, L: 0
0429 19:54:45.657438 (+ 217us) write_op.cc:270] Start()
0429 19:54:45.657460 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473820814 usec, L: 0
0429 19:54:45.657614 (+ 154us) write_op.cc:270] Start()
0429 19:54:45.657634 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473832130 usec, L: 0
0429 19:54:45.657776 (+ 142us) write_op.cc:270] Start()
0429 19:54:45.657794 (+ 18us) write_op.cc:276] Timestamp: P: 1777492473847829 usec, L: 0
0429 19:54:45.657918 (+ 124us) write_op.cc:270] Start()
0429 19:54:45.657943 (+ 25us) write_op.cc:276] Timestamp: P: 1777492473860915 usec, L: 0
0429 19:54:45.658094 (+ 151us) write_op.cc:270] Start()
0429 19:54:45.658114 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473885647 usec, L: 0
0429 19:54:45.658322 (+ 208us) write_op.cc:270] Start()
0429 19:54:45.658343 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473895356 usec, L: 0
0429 19:54:45.661070 (+ 2727us) write_op.cc:270] Start()
0429 19:54:45.661095 (+ 25us) write_op.cc:276] Timestamp: P: 1777492473908413 usec, L: 0
0429 19:54:45.661325 (+ 230us) write_op.cc:270] Start()
0429 19:54:45.661348 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473928249 usec, L: 0
0429 19:54:45.661503 (+ 155us) write_op.cc:270] Start()
0429 19:54:45.661523 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473946007 usec, L: 0
0429 19:54:45.661716 (+ 193us) write_op.cc:270] Start()
0429 19:54:45.661738 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473950166 usec, L: 0
0429 19:54:45.661903 (+ 165us) write_op.cc:270] Start()
0429 19:54:45.661923 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473988804 usec, L: 0
0429 19:54:45.662070 (+ 147us) write_op.cc:270] Start()
0429 19:54:45.662090 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473989836 usec, L: 0
0429 19:54:45.662243 (+ 153us) write_op.cc:270] Start()
0429 19:54:45.662277 (+ 34us) write_op.cc:276] Timestamp: P: 1777492473991998 usec, L: 0
0429 19:54:45.662468 (+ 191us) write_op.cc:270] Start()
0429 19:54:45.662491 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474007694 usec, L: 0
0429 19:54:45.662690 (+ 199us) write_op.cc:270] Start()
0429 19:54:45.662711 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474030048 usec, L: 0
0429 19:54:45.662858 (+ 147us) write_op.cc:270] Start()
0429 19:54:45.662880 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474033511 usec, L: 0
0429 19:54:45.663034 (+ 154us) write_op.cc:270] Start()
0429 19:54:45.663055 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474055641 usec, L: 0
0429 19:54:45.663198 (+ 143us) write_op.cc:270] Start()
0429 19:54:45.663219 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474078782 usec, L: 0
0429 19:54:45.663414 (+ 195us) write_op.cc:270] Start()
0429 19:54:45.663436 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474082927 usec, L: 0
0429 19:54:45.663581 (+ 145us) write_op.cc:270] Start()
0429 19:54:45.663619 (+ 38us) write_op.cc:276] Timestamp: P: 1777492474101420 usec, L: 0
0429 19:54:45.663805 (+ 186us) write_op.cc:270] Start()
0429 19:54:45.663860 (+ 55us) write_op.cc:276] Timestamp: P: 1777492474110399 usec, L: 0
0429 19:54:45.664032 (+ 172us) write_op.cc:270] Start()
0429 19:54:45.664051 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474144817 usec, L: 0
0429 19:54:45.664182 (+ 131us) write_op.cc:270] Start()
0429 19:54:45.664205 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474169051 usec, L: 0
0429 19:54:45.664404 (+ 199us) write_op.cc:270] Start()
0429 19:54:45.664427 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474177060 usec, L: 0
0429 19:54:45.664624 (+ 197us) write_op.cc:270] Start()
0429 19:54:45.664645 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474185356 usec, L: 0
0429 19:54:45.664796 (+ 151us) write_op.cc:270] Start()
0429 19:54:45.664817 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474232992 usec, L: 0
0429 19:54:45.664975 (+ 158us) write_op.cc:270] Start()
0429 19:54:45.664997 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474242218 usec, L: 0
0429 19:54:45.665139 (+ 142us) write_op.cc:270] Start()
0429 19:54:45.665159 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474253093 usec, L: 0
0429 19:54:45.665347 (+ 188us) write_op.cc:270] Start()
0429 19:54:45.665369 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474253914 usec, L: 0
0429 19:54:45.665515 (+ 146us) write_op.cc:270] Start()
0429 19:54:45.665535 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474294580 usec, L: 0
0429 19:54:45.665716 (+ 181us) write_op.cc:270] Start()
0429 19:54:45.665739 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474307917 usec, L: 0
0429 19:54:45.665888 (+ 149us) write_op.cc:270] Start()
0429 19:54:45.665910 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474324093 usec, L: 0
0429 19:54:45.666065 (+ 155us) write_op.cc:270] Start()
0429 19:54:45.666086 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474339927 usec, L: 0
0429 19:54:45.666220 (+ 134us) write_op.cc:270] Start()
0429 19:54:45.666240 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474359138 usec, L: 0
0429 19:54:45.670374 (+ 4134us) write_op.cc:270] Start()
0429 19:54:45.677254 (+ 6880us) write_op.cc:276] Timestamp: P: 1777492474370621 usec, L: 0
0429 19:54:45.679032 (+ 1778us) write_op.cc:270] Start()
0429 19:54:45.679063 (+ 31us) write_op.cc:276] Timestamp: P: 1777492474405050 usec, L: 0
0429 19:54:45.679282 (+ 219us) write_op.cc:270] Start()
0429 19:54:45.679318 (+ 36us) write_op.cc:276] Timestamp: P: 1777492474413882 usec, L: 0
0429 19:54:45.679474 (+ 156us) write_op.cc:270] Start()
0429 19:54:45.679500 (+ 26us) write_op.cc:276] Timestamp: P: 1777492474423333 usec, L: 0
0429 19:54:45.679634 (+ 134us) write_op.cc:270] Start()
0429 19:54:45.679658 (+ 24us) write_op.cc:276] Timestamp: P: 1777492474436530 usec, L: 0
0429 19:54:45.679839 (+ 181us) write_op.cc:270] Start()
0429 19:54:45.679860 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474462020 usec, L: 0
0429 19:54:45.680008 (+ 148us) write_op.cc:270] Start()
0429 19:54:45.680026 (+ 18us) write_op.cc:276] Timestamp: P: 1777492474480485 usec, L: 0
0429 19:54:45.684360 (+ 4334us) write_op.cc:270] Start()
0429 19:54:45.684389 (+ 29us) write_op.cc:276] Timestamp: P: 1777492474488262 usec, L: 0
0429 19:54:45.684578 (+ 189us) write_op.cc:270] Start()
0429 19:54:45.684599 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474508032 usec, L: 0
0429 19:54:45.688326 (+ 3727us) write_op.cc:270] Start()
0429 19:54:45.688358 (+ 32us) write_op.cc:276] Timestamp: P: 1777492474546540 usec, L: 0
0429 19:54:45.688597 (+ 239us) write_op.cc:270] Start()
0429 19:54:45.688620 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474560136 usec, L: 0
0429 19:54:45.727512 (+ 38892us) write_op.cc:270] Start()
0429 19:54:45.727552 (+ 40us) write_op.cc:276] Timestamp: P: 1777492474571875 usec, L: 0
0429 19:54:45.755763 (+ 28211us) write_op.cc:270] Start()
0429 19:54:45.755793 (+ 30us) write_op.cc:276] Timestamp: P: 1777492474575152 usec, L: 0
0429 19:54:45.756002 (+ 209us) write_op.cc:270] Start()
0429 19:54:45.756024 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474588344 usec, L: 0
0429 19:54:45.757111 (+ 1087us) write_op.cc:270] Start()
0429 19:54:45.757139 (+ 28us) write_op.cc:276] Timestamp: P: 1777492474615737 usec, L: 0
0429 19:54:45.757553 (+ 414us) write_op.cc:270] Start()
0429 19:54:45.757577 (+ 24us) write_op.cc:276] Timestamp: P: 1777492474634904 usec, L: 0
0429 19:54:45.757757 (+ 180us) write_op.cc:270] Start()
0429 19:54:45.757776 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474636421 usec, L: 0
0429 19:54:45.758413 (+ 637us) write_op.cc:270] Start()
0429 19:54:45.758433 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474650664 usec, L: 0
0429 19:54:45.758581 (+ 148us) write_op.cc:270] Start()
0429 19:54:45.758599 (+ 18us) write_op.cc:276] Timestamp: P: 1777492474681087 usec, L: 0
0429 19:54:45.758742 (+ 143us) write_op.cc:270] Start()
0429 19:54:45.758759 (+ 17us) write_op.cc:276] Timestamp: P: 1777492474702225 usec, L: 0
0429 19:54:45.758904 (+ 145us) write_op.cc:270] Start()
0429 19:54:45.758922 (+ 18us) write_op.cc:276] Timestamp: P: 1777492474706448 usec, L: 0
0429 19:54:45.760696 (+ 1774us) write_op.cc:270] Start()
0429 19:54:45.760722 (+ 26us) write_op.cc:276] Timestamp: P: 1777492474709959 usec, L: 0
0429 19:54:45.760884 (+ 162us) write_op.cc:270] Start()
0429 19:54:45.760905 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474733428 usec, L: 0
0429 19:54:45.761051 (+ 146us) write_op.cc:270] Start()
0429 19:54:45.761071 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474744444 usec, L: 0
0429 19:54:45.761212 (+ 141us) write_op.cc:270] Start()
0429 19:54:45.761240 (+ 28us) write_op.cc:276] Timestamp: P: 1777492474756021 usec, L: 0
0429 19:54:45.761397 (+ 157us) write_op.cc:270] Start()
0429 19:54:45.761417 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474771345 usec, L: 0
0429 19:54:45.761557 (+ 140us) write_op.cc:270] Start()
0429 19:54:45.761577 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474776029 usec, L: 0
0429 19:54:45.761738 (+ 161us) write_op.cc:270] Start()
0429 19:54:45.761758 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474802589 usec, L: 0
0429 19:54:45.775816 (+ 14058us) write_op.cc:270] Start()
0429 19:54:45.775846 (+ 30us) write_op.cc:276] Timestamp: P: 1777492474822393 usec, L: 0
0429 19:54:45.784012 (+ 8166us) write_op.cc:270] Start()
0429 19:54:45.784030 (+ 18us) write_op.cc:276] Timestamp: P: 1777492474834760 usec, L: 0
0429 19:54:45.791917 (+ 7887us) write_op.cc:270] Start()
0429 19:54:45.791946 (+ 29us) write_op.cc:276] Timestamp: P: 1777492474858242 usec, L: 0
0429 19:54:45.794748 (+ 2802us) write_op.cc:270] Start()
0429 19:54:45.794773 (+ 25us) write_op.cc:276] Timestamp: P: 1777492474867378 usec, L: 0
0429 19:54:45.795774 (+ 1001us) write_op.cc:270] Start()
0429 19:54:45.795795 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474871875 usec, L: 0
0429 19:54:45.796877 (+ 1082us) write_op.cc:270] Start()
0429 19:54:45.796895 (+ 18us) write_op.cc:276] Timestamp: P: 1777492474874941 usec, L: 0
0429 19:54:45.797003 (+ 108us) write_op.cc:270] Start()
0429 19:54:45.797018 (+ 15us) write_op.cc:276] Timestamp: P: 1777492474923697 usec, L: 0
0429 19:54:45.800560 (+ 3542us) write_op.cc:270] Start()
0429 19:54:45.800586 (+ 26us) write_op.cc:276] Timestamp: P: 1777492474946705 usec, L: 0
0429 19:54:45.800873 (+ 287us) write_op.cc:270] Start()
0429 19:54:45.800897 (+ 24us) write_op.cc:276] Timestamp: P: 1777492474949334 usec, L: 0
0429 19:54:45.801057 (+ 160us) write_op.cc:270] Start()
0429 19:54:45.801077 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474951817 usec, L: 0
0429 19:54:45.801230 (+ 153us) write_op.cc:270] Start()
0429 19:54:45.801253 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474978862 usec, L: 0
0429 19:54:45.801551 (+ 298us) write_op.cc:270] Start()
0429 19:54:45.801576 (+ 25us) write_op.cc:276] Timestamp: P: 1777492475007199 usec, L: 0
0429 19:54:45.801751 (+ 175us) write_op.cc:270] Start()
0429 19:54:45.801775 (+ 24us) write_op.cc:276] Timestamp: P: 1777492475009795 usec, L: 0
0429 19:54:45.801924 (+ 149us) write_op.cc:270] Start()
0429 19:54:45.801950 (+ 26us) write_op.cc:276] Timestamp: P: 1777492475011579 usec, L: 0
0429 19:54:45.802097 (+ 147us) write_op.cc:270] Start()
0429 19:54:45.802117 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475021254 usec, L: 0
0429 19:54:45.802291 (+ 174us) write_op.cc:270] Start()
0429 19:54:45.802312 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475044809 usec, L: 0
0429 19:54:45.802500 (+ 188us) write_op.cc:270] Start()
0429 19:54:45.802522 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475065774 usec, L: 0
0429 19:54:45.802655 (+ 133us) write_op.cc:270] Start()
0429 19:54:45.802673 (+ 18us) write_op.cc:276] Timestamp: P: 1777492475074266 usec, L: 0
0429 19:54:45.802845 (+ 172us) write_op.cc:270] Start()
0429 19:54:45.802864 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475083838 usec, L: 0
0429 19:54:45.803003 (+ 139us) write_op.cc:270] Start()
0429 19:54:45.803023 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475111788 usec, L: 0
0429 19:54:45.803170 (+ 147us) write_op.cc:270] Start()
0429 19:54:45.803191 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475113297 usec, L: 0
0429 19:54:45.803349 (+ 158us) write_op.cc:270] Start()
0429 19:54:45.803369 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475138384 usec, L: 0
0429 19:54:45.803498 (+ 129us) write_op.cc:270] Start()
0429 19:54:45.803517 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475151097 usec, L: 0
0429 19:54:45.803660 (+ 143us) write_op.cc:270] Start()
0429 19:54:45.803679 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475165888 usec, L: 0
0429 19:54:45.803821 (+ 142us) write_op.cc:270] Start()
0429 19:54:45.803841 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475173293 usec, L: 0
0429 19:54:45.804028 (+ 187us) write_op.cc:270] Start()
0429 19:54:45.804051 (+ 23us) write_op.cc:276] Timestamp: P: 1777492475202694 usec, L: 0
0429 19:54:45.804210 (+ 159us) write_op.cc:270] Start()
0429 19:54:45.804243 (+ 33us) write_op.cc:276] Timestamp: P: 1777492475206705 usec, L: 0
0429 19:54:45.804384 (+ 141us) write_op.cc:270] Start()
0429 19:54:45.804405 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475218702 usec, L: 0
0429 19:54:45.804552 (+ 147us) write_op.cc:270] Start()
0429 19:54:45.804572 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475222627 usec, L: 0
0429 19:54:45.804717 (+ 145us) write_op.cc:270] Start()
0429 19:54:45.804736 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475254998 usec, L: 0
0429 19:54:45.804874 (+ 138us) write_op.cc:270] Start()
0429 19:54:45.804907 (+ 33us) write_op.cc:276] Timestamp: P: 1777492475256198 usec, L: 0
0429 19:54:45.805098 (+ 191us) write_op.cc:270] Start()
0429 19:54:45.805120 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475274094 usec, L: 0
0429 19:54:45.805345 (+ 225us) write_op.cc:270] Start()
0429 19:54:45.805366 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475281853 usec, L: 0
0429 19:54:45.805499 (+ 133us) write_op.cc:270] Start()
0429 19:54:45.805518 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475307401 usec, L: 0
0429 19:54:45.805675 (+ 157us) write_op.cc:270] Start()
0429 19:54:45.805695 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475330000 usec, L: 0
0429 19:54:45.805826 (+ 131us) write_op.cc:270] Start()
0429 19:54:45.805843 (+ 17us) write_op.cc:276] Timestamp: P: 1777492475333261 usec, L: 0
0429 19:54:45.805989 (+ 146us) write_op.cc:270] Start()
0429 19:54:45.806010 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475336187 usec, L: 0
0429 19:54:45.806151 (+ 141us) write_op.cc:270] Start()
0429 19:54:45.806169 (+ 18us) write_op.cc:276] Timestamp: P: 1777492475379266 usec, L: 0
0429 19:54:45.811882 (+ 5713us) write_op.cc:270] Start()
0429 19:54:45.811917 (+ 35us) write_op.cc:276] Timestamp: P: 1777492475407113 usec, L: 0
0429 19:54:45.814542 (+ 2625us) write_op.cc:270] Start()
0429 19:54:45.814569 (+ 27us) write_op.cc:276] Timestamp: P: 1777492475410013 usec, L: 0
0429 19:54:45.833130 (+ 18561us) spinlock_profiling.cc:243] Waited 924 us on lock 0x60f0000180c8. stack: 00007faa35dc9086 00007faa35dc8e40 00007faa34d823ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007faa3ed9a928 00007faa41d25399 00007faa41ccc4b9 00007faa41cc9cc7 00007faa45b4e59d 00007faa3fcdab46 00007faa3fcda875 00007faa3cd9a65e 00007faa3cd9953e 00007faa3cd9f738
0429 19:54:45.844736 (+ 11606us) write_op.cc:270] Start()
0429 19:54:45.846864 (+ 2128us) write_op.cc:276] Timestamp: P: 1777492475421816 usec, L: 0
0429 19:54:45.846986 (+ 122us) write_op.cc:270] Start()
0429 19:54:45.847005 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475440988 usec, L: 0
0429 19:54:45.861179 (+ 14174us) write_op.cc:270] Start()
0429 19:54:45.861191 (+ 12us) write_op.cc:276] Timestamp: P: 1777492475466865 usec, L: 0
0429 19:54:45.867238 (+ 6047us) write_op.cc:270] Start()
0429 19:54:45.867271 (+ 33us) write_op.cc:276] Timestamp: P: 1777492475501016 usec, L: 0
0429 19:54:45.874325 (+ 7054us) write_op.cc:270] Start()
0429 19:54:45.874357 (+ 32us) write_op.cc:276] Timestamp: P: 1777492475507110 usec, L: 0
0429 19:54:45.874594 (+ 237us) write_op.cc:270] Start()
0429 19:54:45.874616 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475514027 usec, L: 0
0429 19:54:45.874751 (+ 135us) write_op.cc:270] Start()
0429 19:54:45.881210 (+ 6459us) write_op.cc:276] Timestamp: P: 1777492475517589 usec, L: 0
0429 19:54:45.881486 (+ 276us) write_op.cc:270] Start()
0429 19:54:45.881513 (+ 27us) write_op.cc:276] Timestamp: P: 1777492475541814 usec, L: 0
0429 19:54:45.881698 (+ 185us) write_op.cc:270] Start()
0429 19:54:45.881716 (+ 18us) write_op.cc:276] Timestamp: P: 1777492475582454 usec, L: 0
0429 19:54:45.881831 (+ 115us) write_op.cc:270] Start()
0429 19:54:45.881847 (+ 16us) write_op.cc:276] Timestamp: P: 1777492475586026 usec, L: 0
0429 19:54:45.881983 (+ 136us) write_op.cc:270] Start()
0429 19:54:45.881999 (+ 16us) write_op.cc:276] Timestamp: P: 1777492475590914 usec, L: 0
0429 19:54:45.882115 (+ 116us) write_op.cc:270] Start()
0429 19:54:45.882130 (+ 15us) write_op.cc:276] Timestamp: P: 1777492475593278 usec, L: 0
0429 19:54:45.890644 (+ 8514us) write_op.cc:270] Start()
0429 19:54:45.890677 (+ 33us) write_op.cc:276] Timestamp: P: 1777492475638595 usec, L: 0
0429 19:54:45.890896 (+ 219us) write_op.cc:270] Start()
0429 19:54:45.890916 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475649128 usec, L: 0
0429 19:54:45.891036 (+ 120us) write_op.cc:270] Start()
0429 19:54:45.891052 (+ 16us) write_op.cc:276] Timestamp: P: 1777492475660478 usec, L: 0
0429 19:54:45.896304 (+ 5252us) write_op.cc:270] Start()
0429 19:54:45.896342 (+ 38us) write_op.cc:276] Timestamp: P: 1777492475671776 usec, L: 0
0429 19:54:45.896553 (+ 211us) write_op.cc:270] Start()
0429 19:54:45.896578 (+ 25us) write_op.cc:276] Timestamp: P: 1777492475698251 usec, L: 0
0429 19:54:45.896740 (+ 162us) write_op.cc:270] Start()
0429 19:54:45.896762 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475710926 usec, L: 0
0429 19:54:45.901077 (+ 4315us) write_op.cc:270] Start()
0429 19:54:45.901116 (+ 39us) write_op.cc:276] Timestamp: P: 1777492475750127 usec, L: 0
0429 19:54:45.901338 (+ 222us) write_op.cc:270] Start()
0429 19:54:45.901360 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475753364 usec, L: 0
0429 19:54:45.901516 (+ 156us) write_op.cc:270] Start()
0429 19:54:45.901535 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475764907 usec, L: 0
0429 19:54:45.901663 (+ 128us) write_op.cc:270] Start()
0429 19:54:45.901685 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475773337 usec, L: 0
0429 19:54:45.901813 (+ 128us) write_op.cc:270] Start()
0429 19:54:45.901831 (+ 18us) write_op.cc:276] Timestamp: P: 1777492475800097 usec, L: 0
0429 19:54:45.901968 (+ 137us) write_op.cc:270] Start()
0429 19:54:45.901988 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475807204 usec, L: 0
0429 19:54:45.902856 (+ 868us) write_op.cc:270] Start()
0429 19:54:45.902881 (+ 25us) write_op.cc:276] Timestamp: P: 1777492475843514 usec, L: 0
0429 19:54:45.903044 (+ 163us) write_op.cc:270] Start()
0429 19:54:45.903070 (+ 26us) write_op.cc:276] Timestamp: P: 1777492475857215 usec, L: 0
0429 19:54:45.903228 (+ 158us) write_op.cc:270] Start()
0429 19:54:45.903248 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475873358 usec, L: 0
0429 19:54:45.914783 (+ 11535us) write_op.cc:270] Start()
0429 19:54:45.914811 (+ 28us) write_op.cc:276] Timestamp: P: 1777492475876130 usec, L: 0
0429 19:54:45.924824 (+ 10013us) write_op.cc:270] Start()
0429 19:54:45.924867 (+ 43us) write_op.cc:276] Timestamp: P: 1777492475923794 usec, L: 0
0429 19:54:45.925101 (+ 234us) write_op.cc:270] Start()
0429 19:54:45.925121 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475944643 usec, L: 0
0429 19:54:45.925262 (+ 141us) write_op.cc:270] Start()
0429 19:54:45.925281 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475963083 usec, L: 0
0429 19:54:45.925423 (+ 142us) write_op.cc:270] Start()
0429 19:54:45.925441 (+ 18us) write_op.cc:276] Timestamp: P: 1777492475963715 usec, L: 0
0429 19:54:45.925590 (+ 1
I20260429 19:54:46.821643 11353 rpcz_store.cc:276] 0429 19:54:44.457063 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 19:54:44.457239 (+ 176us) service_pool.cc:225] Handling call
0429 19:54:44.512922 (+ 55683us) raft_consensus.cc:1471] Updating replica for 606 ops
0429 19:54:44.734618 (+221696us) raft_consensus.cc:1534] Early marking committed up to index 148
0429 19:54:44.854771 (+120153us) write_op.cc:489] Releasing partition, row and schema locks
0429 19:54:44.854777 (+ 6us) write_op.cc:454] Released schema lock
0429 19:54:44.854890 (+ 113us) raft_consensus.cc:1539] Triggering prepare for 606 ops
0429 19:54:44.866378 (+ 11488us) write_op.cc:270] Start()
0429 19:54:44.866436 (+ 58us) write_op.cc:276] Timestamp: P: 1777492472678175 usec, L: 0
0429 19:54:44.866689 (+ 253us) write_op.cc:270] Start()
0429 19:54:44.866716 (+ 27us) write_op.cc:276] Timestamp: P: 1777492472680544 usec, L: 0
0429 19:54:44.866886 (+ 170us) write_op.cc:270] Start()
0429 19:54:44.866912 (+ 26us) write_op.cc:276] Timestamp: P: 1777492472692116 usec, L: 0
0429 19:54:44.867076 (+ 164us) write_op.cc:270] Start()
0429 19:54:44.867096 (+ 20us) write_op.cc:276] Timestamp: P: 1777492472826141 usec, L: 0
0429 19:54:44.867267 (+ 171us) write_op.cc:270] Start()
0429 19:54:44.867288 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473032648 usec, L: 0
0429 19:54:44.867491 (+ 203us) write_op.cc:270] Start()
0429 19:54:44.867515 (+ 24us) write_op.cc:276] Timestamp: P: 1777492473045465 usec, L: 0
0429 19:54:44.867674 (+ 159us) write_op.cc:270] Start()
0429 19:54:44.867700 (+ 26us) write_op.cc:276] Timestamp: P: 1777492473061015 usec, L: 0
0429 19:54:44.867854 (+ 154us) write_op.cc:270] Start()
0429 19:54:44.867875 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473064069 usec, L: 0
0429 19:54:44.868035 (+ 160us) write_op.cc:270] Start()
0429 19:54:44.868054 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473069707 usec, L: 0
0429 19:54:44.868194 (+ 140us) write_op.cc:270] Start()
0429 19:54:44.868211 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473096471 usec, L: 0
0429 19:54:44.868356 (+ 145us) write_op.cc:270] Start()
0429 19:54:44.868373 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473124725 usec, L: 0
0429 19:54:44.868510 (+ 137us) write_op.cc:270] Start()
0429 19:54:44.868527 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473144849 usec, L: 0
0429 19:54:44.868643 (+ 116us) write_op.cc:270] Start()
0429 19:54:44.868659 (+ 16us) write_op.cc:276] Timestamp: P: 1777492473155257 usec, L: 0
0429 19:54:44.868764 (+ 105us) write_op.cc:270] Start()
0429 19:54:44.868779 (+ 15us) write_op.cc:276] Timestamp: P: 1777492473158211 usec, L: 0
0429 19:54:44.868916 (+ 137us) write_op.cc:270] Start()
0429 19:54:44.868933 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473182488 usec, L: 0
0429 19:54:44.869090 (+ 157us) write_op.cc:270] Start()
0429 19:54:44.869109 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473198639 usec, L: 0
0429 19:54:44.869275 (+ 166us) write_op.cc:270] Start()
0429 19:54:44.869301 (+ 26us) write_op.cc:276] Timestamp: P: 1777492473199730 usec, L: 0
0429 19:54:44.869441 (+ 140us) write_op.cc:270] Start()
0429 19:54:44.869458 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473210438 usec, L: 0
0429 19:54:44.869588 (+ 130us) write_op.cc:270] Start()
0429 19:54:44.869603 (+ 15us) write_op.cc:276] Timestamp: P: 1777492473224158 usec, L: 0
0429 19:54:44.869729 (+ 126us) write_op.cc:270] Start()
0429 19:54:44.869748 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473259227 usec, L: 0
0429 19:54:44.869892 (+ 144us) write_op.cc:270] Start()
0429 19:54:44.869910 (+ 18us) write_op.cc:276] Timestamp: P: 1777492473259865 usec, L: 0
0429 19:54:44.870020 (+ 110us) write_op.cc:270] Start()
0429 19:54:44.870034 (+ 14us) write_op.cc:276] Timestamp: P: 1777492473260390 usec, L: 0
0429 19:54:44.870164 (+ 130us) write_op.cc:270] Start()
0429 19:54:44.870203 (+ 39us) write_op.cc:276] Timestamp: P: 1777492473286046 usec, L: 0
0429 19:54:44.870313 (+ 110us) write_op.cc:270] Start()
0429 19:54:44.870330 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473310867 usec, L: 0
0429 19:54:44.870738 (+ 408us) write_op.cc:270] Start()
0429 19:54:44.870762 (+ 24us) write_op.cc:276] Timestamp: P: 1777492473332784 usec, L: 0
0429 19:54:44.883438 (+ 12676us) write_op.cc:270] Start()
0429 19:54:44.883479 (+ 41us) write_op.cc:276] Timestamp: P: 1777492473333972 usec, L: 0
0429 19:54:44.886149 (+ 2670us) write_op.cc:270] Start()
0429 19:54:44.886197 (+ 48us) write_op.cc:276] Timestamp: P: 1777492473353579 usec, L: 0
0429 19:54:44.887754 (+ 1557us) write_op.cc:270] Start()
0429 19:54:44.887788 (+ 34us) write_op.cc:276] Timestamp: P: 1777492473368787 usec, L: 0
0429 19:54:44.888635 (+ 847us) write_op.cc:270] Start()
0429 19:54:44.888664 (+ 29us) write_op.cc:276] Timestamp: P: 1777492473399191 usec, L: 0
0429 19:54:44.889174 (+ 510us) write_op.cc:270] Start()
0429 19:54:44.889202 (+ 28us) write_op.cc:276] Timestamp: P: 1777492473420248 usec, L: 0
0429 19:54:44.891039 (+ 1837us) write_op.cc:270] Start()
0429 19:54:44.891068 (+ 29us) write_op.cc:276] Timestamp: P: 1777492473432902 usec, L: 0
0429 19:54:44.894625 (+ 3557us) write_op.cc:270] Start()
0429 19:54:44.894646 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473459796 usec, L: 0
0429 19:54:44.894798 (+ 152us) write_op.cc:270] Start()
0429 19:54:44.894814 (+ 16us) write_op.cc:276] Timestamp: P: 1777492473462488 usec, L: 0
0429 19:54:44.894943 (+ 129us) write_op.cc:270] Start()
0429 19:54:44.894960 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473475510 usec, L: 0
0429 19:54:44.895079 (+ 119us) write_op.cc:270] Start()
0429 19:54:44.895094 (+ 15us) write_op.cc:276] Timestamp: P: 1777492473477762 usec, L: 0
0429 19:54:44.895234 (+ 140us) write_op.cc:270] Start()
0429 19:54:44.895252 (+ 18us) write_op.cc:276] Timestamp: P: 1777492473514299 usec, L: 0
0429 19:54:44.895373 (+ 121us) write_op.cc:270] Start()
0429 19:54:44.899979 (+ 4606us) write_op.cc:276] Timestamp: P: 1777492473518245 usec, L: 0
0429 19:54:44.900183 (+ 204us) write_op.cc:270] Start()
0429 19:54:44.900206 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473522901 usec, L: 0
0429 19:54:44.900355 (+ 149us) write_op.cc:270] Start()
0429 19:54:44.900376 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473523602 usec, L: 0
0429 19:54:44.900525 (+ 149us) write_op.cc:270] Start()
0429 19:54:44.900545 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473556958 usec, L: 0
0429 19:54:44.900682 (+ 137us) write_op.cc:270] Start()
0429 19:54:44.900702 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473562530 usec, L: 0
0429 19:54:44.900854 (+ 152us) write_op.cc:270] Start()
0429 19:54:44.900893 (+ 39us) write_op.cc:276] Timestamp: P: 1777492473574819 usec, L: 0
0429 19:54:44.901034 (+ 141us) write_op.cc:270] Start()
0429 19:54:44.901053 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473580264 usec, L: 0
0429 19:54:44.901201 (+ 148us) write_op.cc:270] Start()
0429 19:54:44.901221 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473594722 usec, L: 0
0429 19:54:44.901392 (+ 171us) write_op.cc:270] Start()
0429 19:54:44.901413 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473611013 usec, L: 0
0429 19:54:44.901578 (+ 165us) write_op.cc:270] Start()
0429 19:54:44.901599 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473626275 usec, L: 0
0429 19:54:44.901738 (+ 139us) write_op.cc:270] Start()
0429 19:54:44.901759 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473650611 usec, L: 0
0429 19:54:44.901917 (+ 158us) write_op.cc:270] Start()
0429 19:54:44.901937 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473661807 usec, L: 0
0429 19:54:44.904553 (+ 2616us) write_op.cc:270] Start()
0429 19:54:44.904583 (+ 30us) write_op.cc:276] Timestamp: P: 1777492473675872 usec, L: 0
0429 19:54:44.910064 (+ 5481us) write_op.cc:270] Start()
0429 19:54:44.910097 (+ 33us) write_op.cc:276] Timestamp: P: 1777492473691559 usec, L: 0
0429 19:54:44.911463 (+ 1366us) write_op.cc:270] Start()
0429 19:54:44.911493 (+ 30us) write_op.cc:276] Timestamp: P: 1777492473716625 usec, L: 0
0429 19:54:44.911670 (+ 177us) write_op.cc:270] Start()
0429 19:54:44.911688 (+ 18us) write_op.cc:276] Timestamp: P: 1777492473721616 usec, L: 0
0429 19:54:44.911829 (+ 141us) write_op.cc:270] Start()
0429 19:54:44.911855 (+ 26us) write_op.cc:276] Timestamp: P: 1777492473725996 usec, L: 0
0429 19:54:44.911992 (+ 137us) write_op.cc:270] Start()
0429 19:54:44.912009 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473742020 usec, L: 0
0429 19:54:44.912194 (+ 185us) write_op.cc:270] Start()
0429 19:54:44.912212 (+ 18us) write_op.cc:276] Timestamp: P: 1777492473744254 usec, L: 0
0429 19:54:44.912360 (+ 148us) write_op.cc:270] Start()
0429 19:54:44.912378 (+ 18us) write_op.cc:276] Timestamp: P: 1777492473769721 usec, L: 0
0429 19:54:44.912506 (+ 128us) write_op.cc:270] Start()
0429 19:54:44.912521 (+ 15us) write_op.cc:276] Timestamp: P: 1777492473787345 usec, L: 0
0429 19:54:44.912644 (+ 123us) write_op.cc:270] Start()
0429 19:54:44.912661 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473788048 usec, L: 0
0429 19:54:44.912806 (+ 145us) write_op.cc:270] Start()
0429 19:54:44.912823 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473821090 usec, L: 0
0429 19:54:44.912940 (+ 117us) write_op.cc:270] Start()
0429 19:54:44.912968 (+ 28us) write_op.cc:276] Timestamp: P: 1777492473822689 usec, L: 0
0429 19:54:44.913109 (+ 141us) write_op.cc:270] Start()
0429 19:54:44.913128 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473831986 usec, L: 0
0429 19:54:44.913251 (+ 123us) write_op.cc:270] Start()
0429 19:54:44.913269 (+ 18us) write_op.cc:276] Timestamp: P: 1777492473862606 usec, L: 0
0429 19:54:44.913393 (+ 124us) write_op.cc:270] Start()
0429 19:54:44.913410 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473888606 usec, L: 0
0429 19:54:44.913559 (+ 149us) write_op.cc:270] Start()
0429 19:54:44.913576 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473893007 usec, L: 0
0429 19:54:44.913736 (+ 160us) write_op.cc:270] Start()
0429 19:54:44.913754 (+ 18us) write_op.cc:276] Timestamp: P: 1777492473908292 usec, L: 0
0429 19:54:44.913884 (+ 130us) write_op.cc:270] Start()
0429 19:54:44.913901 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473926217 usec, L: 0
0429 19:54:44.914027 (+ 126us) write_op.cc:270] Start()
0429 19:54:44.914044 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473938701 usec, L: 0
0429 19:54:44.914167 (+ 123us) write_op.cc:270] Start()
0429 19:54:44.914184 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473944843 usec, L: 0
0429 19:54:44.914315 (+ 131us) write_op.cc:270] Start()
0429 19:54:44.914332 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473973430 usec, L: 0
0429 19:54:44.933719 (+ 19387us) write_op.cc:270] Start()
0429 19:54:44.933753 (+ 34us) write_op.cc:276] Timestamp: P: 1777492473980133 usec, L: 0
0429 19:54:44.933933 (+ 180us) write_op.cc:270] Start()
0429 19:54:44.933953 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474000323 usec, L: 0
0429 19:54:44.934112 (+ 159us) write_op.cc:270] Start()
0429 19:54:44.934132 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474007132 usec, L: 0
0429 19:54:44.950362 (+ 16230us) write_op.cc:270] Start()
0429 19:54:44.950410 (+ 48us) write_op.cc:276] Timestamp: P: 1777492474030669 usec, L: 0
0429 19:54:44.951188 (+ 778us) write_op.cc:270] Start()
0429 19:54:44.951206 (+ 18us) write_op.cc:276] Timestamp: P: 1777492474031766 usec, L: 0
0429 19:54:44.951332 (+ 126us) write_op.cc:270] Start()
0429 19:54:44.951353 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474052354 usec, L: 0
0429 19:54:44.951479 (+ 126us) write_op.cc:270] Start()
0429 19:54:44.951495 (+ 16us) write_op.cc:276] Timestamp: P: 1777492474081496 usec, L: 0
0429 19:54:44.976002 (+ 24507us) write_op.cc:270] Start()
0429 19:54:44.976041 (+ 39us) write_op.cc:276] Timestamp: P: 1777492474083652 usec, L: 0
0429 19:54:44.976255 (+ 214us) write_op.cc:270] Start()
0429 19:54:44.976279 (+ 24us) write_op.cc:276] Timestamp: P: 1777492474102121 usec, L: 0
0429 19:54:44.986678 (+ 10399us) write_op.cc:270] Start()
0429 19:54:44.986746 (+ 68us) write_op.cc:276] Timestamp: P: 1777492474112449 usec, L: 0
0429 19:54:45.001707 (+ 14961us) write_op.cc:270] Start()
0429 19:54:45.001735 (+ 28us) write_op.cc:276] Timestamp: P: 1777492474154705 usec, L: 0
0429 19:54:45.001914 (+ 179us) write_op.cc:270] Start()
0429 19:54:45.001935 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474161433 usec, L: 0
0429 19:54:45.007957 (+ 6022us) write_op.cc:270] Start()
0429 19:54:45.007984 (+ 27us) write_op.cc:276] Timestamp: P: 1777492474180262 usec, L: 0
0429 19:54:45.008937 (+ 953us) write_op.cc:270] Start()
0429 19:54:45.008964 (+ 27us) write_op.cc:276] Timestamp: P: 1777492474180898 usec, L: 0
0429 19:54:45.009143 (+ 179us) write_op.cc:270] Start()
0429 19:54:45.009166 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474228419 usec, L: 0
0429 19:54:45.009827 (+ 661us) write_op.cc:270] Start()
0429 19:54:45.009851 (+ 24us) write_op.cc:276] Timestamp: P: 1777492474230172 usec, L: 0
0429 19:54:45.014140 (+ 4289us) write_op.cc:270] Start()
0429 19:54:45.014168 (+ 28us) write_op.cc:276] Timestamp: P: 1777492474245829 usec, L: 0
0429 19:54:45.014431 (+ 263us) write_op.cc:270] Start()
0429 19:54:45.014456 (+ 25us) write_op.cc:276] Timestamp: P: 1777492474248160 usec, L: 0
0429 19:54:45.014649 (+ 193us) write_op.cc:270] Start()
0429 19:54:45.014672 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474284579 usec, L: 0
0429 19:54:45.014822 (+ 150us) write_op.cc:270] Start()
0429 19:54:45.014844 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474307827 usec, L: 0
0429 19:54:45.015001 (+ 157us) write_op.cc:270] Start()
0429 19:54:45.015020 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474322331 usec, L: 0
0429 19:54:45.015220 (+ 200us) write_op.cc:270] Start()
0429 19:54:45.015244 (+ 24us) write_op.cc:276] Timestamp: P: 1777492474330055 usec, L: 0
0429 19:54:45.015394 (+ 150us) write_op.cc:270] Start()
0429 19:54:45.015415 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474352246 usec, L: 0
0429 19:54:45.015571 (+ 156us) write_op.cc:270] Start()
0429 19:54:45.015592 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474380509 usec, L: 0
0429 19:54:45.015743 (+ 151us) write_op.cc:270] Start()
0429 19:54:45.015808 (+ 65us) write_op.cc:276] Timestamp: P: 1777492474397654 usec, L: 0
0429 19:54:45.015986 (+ 178us) write_op.cc:270] Start()
0429 19:54:45.016009 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474408932 usec, L: 0
0429 19:54:45.016276 (+ 267us) write_op.cc:270] Start()
0429 19:54:45.016299 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474427552 usec, L: 0
0429 19:54:45.016468 (+ 169us) write_op.cc:270] Start()
0429 19:54:45.016493 (+ 25us) write_op.cc:276] Timestamp: P: 1777492474441069 usec, L: 0
0429 19:54:45.016638 (+ 145us) write_op.cc:270] Start()
0429 19:54:45.016658 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474464792 usec, L: 0
0429 19:54:45.017073 (+ 415us) write_op.cc:270] Start()
0429 19:54:45.017097 (+ 24us) write_op.cc:276] Timestamp: P: 1777492474478485 usec, L: 0
0429 19:54:45.017263 (+ 166us) write_op.cc:270] Start()
0429 19:54:45.017284 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474484274 usec, L: 0
0429 19:54:45.018723 (+ 1439us) write_op.cc:270] Start()
0429 19:54:45.018751 (+ 28us) write_op.cc:276] Timestamp: P: 1777492474507357 usec, L: 0
0429 19:54:45.038868 (+ 20117us) write_op.cc:270] Start()
0429 19:54:45.038912 (+ 44us) write_op.cc:276] Timestamp: P: 1777492474541720 usec, L: 0
0429 19:54:45.042461 (+ 3549us) write_op.cc:270] Start()
0429 19:54:45.042494 (+ 33us) write_op.cc:276] Timestamp: P: 1777492474556854 usec, L: 0
0429 19:54:45.042721 (+ 227us) write_op.cc:270] Start()
0429 19:54:45.042744 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474559551 usec, L: 0
0429 19:54:45.042967 (+ 223us) write_op.cc:270] Start()
0429 19:54:45.042990 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474570205 usec, L: 0
0429 19:54:45.043158 (+ 168us) write_op.cc:270] Start()
0429 19:54:45.043180 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474587405 usec, L: 0
0429 19:54:45.043393 (+ 213us) write_op.cc:270] Start()
0429 19:54:45.043415 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474610975 usec, L: 0
0429 19:54:45.043573 (+ 158us) write_op.cc:270] Start()
0429 19:54:45.043594 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474639022 usec, L: 0
0429 19:54:45.043755 (+ 161us) write_op.cc:270] Start()
0429 19:54:45.043777 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474639714 usec, L: 0
0429 19:54:45.043934 (+ 157us) write_op.cc:270] Start()
0429 19:54:45.043955 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474647948 usec, L: 0
0429 19:54:45.044099 (+ 144us) write_op.cc:270] Start()
0429 19:54:45.044120 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474681995 usec, L: 0
0429 19:54:45.044308 (+ 188us) write_op.cc:270] Start()
0429 19:54:45.044331 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474694003 usec, L: 0
0429 19:54:45.044488 (+ 157us) write_op.cc:270] Start()
0429 19:54:45.044510 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474694645 usec, L: 0
0429 19:54:45.044680 (+ 170us) write_op.cc:270] Start()
0429 19:54:45.044701 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474702287 usec, L: 0
0429 19:54:45.044861 (+ 160us) write_op.cc:270] Start()
0429 19:54:45.044882 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474730031 usec, L: 0
0429 19:54:45.045119 (+ 237us) write_op.cc:270] Start()
0429 19:54:45.045146 (+ 27us) write_op.cc:276] Timestamp: P: 1777492474746362 usec, L: 0
0429 19:54:45.045344 (+ 198us) write_op.cc:270] Start()
0429 19:54:45.045367 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474756179 usec, L: 0
0429 19:54:45.045528 (+ 161us) write_op.cc:270] Start()
0429 19:54:45.045549 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474764468 usec, L: 0
0429 19:54:45.045702 (+ 153us) write_op.cc:270] Start()
0429 19:54:45.045724 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474775556 usec, L: 0
0429 19:54:45.045875 (+ 151us) write_op.cc:270] Start()
0429 19:54:45.045896 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474802111 usec, L: 0
0429 19:54:45.046058 (+ 162us) write_op.cc:270] Start()
0429 19:54:45.046080 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474816866 usec, L: 0
0429 19:54:45.046333 (+ 253us) write_op.cc:270] Start()
0429 19:54:45.046362 (+ 29us) write_op.cc:276] Timestamp: P: 1777492474831889 usec, L: 0
0429 19:54:45.070950 (+ 24588us) write_op.cc:270] Start()
0429 19:54:45.070979 (+ 29us) write_op.cc:276] Timestamp: P: 1777492474857051 usec, L: 0
0429 19:54:45.071186 (+ 207us) write_op.cc:270] Start()
0429 19:54:45.071226 (+ 40us) write_op.cc:276] Timestamp: P: 1777492474863632 usec, L: 0
0429 19:54:45.074746 (+ 3520us) write_op.cc:270] Start()
0429 19:54:45.074769 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474870318 usec, L: 0
0429 19:54:45.074922 (+ 153us) write_op.cc:270] Start()
0429 19:54:45.074941 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474875271 usec, L: 0
0429 19:54:45.075701 (+ 760us) write_op.cc:270] Start()
0429 19:54:45.075728 (+ 27us) write_op.cc:276] Timestamp: P: 1777492474916270 usec, L: 0
0429 19:54:45.083028 (+ 7300us) write_op.cc:270] Start()
0429 19:54:45.083058 (+ 30us) write_op.cc:276] Timestamp: P: 1777492474927584 usec, L: 0
0429 19:54:45.084428 (+ 1370us) write_op.cc:270] Start()
0429 19:54:45.084454 (+ 26us) write_op.cc:276] Timestamp: P: 1777492474934527 usec, L: 0
0429 19:54:45.084659 (+ 205us) write_op.cc:270] Start()
0429 19:54:45.084681 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474938354 usec, L: 0
0429 19:54:45.084825 (+ 144us) write_op.cc:270] Start()
0429 19:54:45.084843 (+ 18us) write_op.cc:276] Timestamp: P: 1777492474973409 usec, L: 0
0429 19:54:45.084982 (+ 139us) write_op.cc:270] Start()
0429 19:54:45.085002 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474993276 usec, L: 0
0429 19:54:45.085155 (+ 153us) write_op.cc:270] Start()
0429 19:54:45.085174 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475001323 usec, L: 0
0429 19:54:45.085366 (+ 192us) write_op.cc:270] Start()
0429 19:54:45.085386 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475003589 usec, L: 0
0429 19:54:45.085521 (+ 135us) write_op.cc:270] Start()
0429 19:54:45.085542 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475018062 usec, L: 0
0429 19:54:45.085685 (+ 143us) write_op.cc:270] Start()
0429 19:54:45.085705 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475041083 usec, L: 0
0429 19:54:45.085852 (+ 147us) write_op.cc:270] Start()
0429 19:54:45.085871 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475063623 usec, L: 0
0429 19:54:45.086007 (+ 136us) write_op.cc:270] Start()
0429 19:54:45.086038 (+ 31us) write_op.cc:276] Timestamp: P: 1777492475069834 usec, L: 0
0429 19:54:45.086236 (+ 198us) write_op.cc:270] Start()
0429 19:54:45.086258 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475077926 usec, L: 0
0429 19:54:45.086441 (+ 183us) write_op.cc:270] Start()
0429 19:54:45.086462 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475103898 usec, L: 0
0429 19:54:45.086600 (+ 138us) write_op.cc:270] Start()
0429 19:54:45.086619 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475109549 usec, L: 0
0429 19:54:45.086747 (+ 128us) write_op.cc:270] Start()
0429 19:54:45.086764 (+ 17us) write_op.cc:276] Timestamp: P: 1777492475121005 usec, L: 0
0429 19:54:45.086907 (+ 143us) write_op.cc:270] Start()
0429 19:54:45.086942 (+ 35us) write_op.cc:276] Timestamp: P: 1777492475136280 usec, L: 0
0429 19:54:45.100118 (+ 13176us) write_op.cc:270] Start()
0429 19:54:45.100144 (+ 26us) write_op.cc:276] Timestamp: P: 1777492475162044 usec, L: 0
0429 19:54:45.110455 (+ 10311us) write_op.cc:270] Start()
0429 19:54:45.110492 (+ 37us) write_op.cc:276] Timestamp: P: 1777492475169710 usec, L: 0
0429 19:54:45.115190 (+ 4698us) write_op.cc:270] Start()
0429 19:54:45.115220 (+ 30us) write_op.cc:276] Timestamp: P: 1777492475203906 usec, L: 0
0429 19:54:45.115412 (+ 192us) write_op.cc:270] Start()
0429 19:54:45.115435 (+ 23us) write_op.cc:276] Timestamp: P: 1777492475206338 usec, L: 0
0429 19:54:45.115593 (+ 158us) write_op.cc:270] Start()
0429 19:54:45.115614 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475213747 usec, L: 0
0429 19:54:45.115899 (+ 285us) write_op.cc:270] Start()
0429 19:54:45.115922 (+ 23us) write_op.cc:276] Timestamp: P: 1777492475220717 usec, L: 0
0429 19:54:45.122953 (+ 7031us) write_op.cc:270] Start()
0429 19:54:45.122994 (+ 41us) write_op.cc:276] Timestamp: P: 1777492475244985 usec, L: 0
0429 19:54:45.123425 (+ 431us) write_op.cc:270] Start()
0429 19:54:45.123453 (+ 28us) write_op.cc:276] Timestamp: P: 1777492475253607 usec, L: 0
0429 19:54:45.154407 (+ 30954us) write_op.cc:270] Start()
0429 19:54:45.154433 (+ 26us) write_op.cc:276] Timestamp: P: 1777492475277053 usec, L: 0
0429 19:54:45.170457 (+ 16024us) write_op.cc:270] Start()
0429 19:54:45.170486 (+ 29us) write_op.cc:276] Timestamp: P: 1777492475278948 usec, L: 0
0429 19:54:45.170661 (+ 175us) write_op.cc:270] Start()
0429 19:54:45.170681 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475315488 usec, L: 0
0429 19:54:45.171643 (+ 962us) write_op.cc:270] Start()
0429 19:54:45.171669 (+ 26us) write_op.cc:276] Timestamp: P: 1777492475320754 usec, L: 0
0429 19:54:45.171842 (+ 173us) write_op.cc:270] Start()
0429 19:54:45.171863 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475321834 usec, L: 0
0429 19:54:45.172041 (+ 178us) write_op.cc:270] Start()
0429 19:54:45.172061 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475324956 usec, L: 0
0429 19:54:45.172212 (+ 151us) write_op.cc:270] Start()
0429 19:54:45.172231 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475370155 usec, L: 0
0429 19:54:45.172396 (+ 165us) write_op.cc:270] Start()
0429 19:54:45.172435 (+ 39us) write_op.cc:276] Timestamp: P: 1777492475401097 usec, L: 0
0429 19:54:45.175795 (+ 3360us) write_op.cc:270] Start()
0429 19:54:45.175820 (+ 25us) write_op.cc:276] Timestamp: P: 1777492475401739 usec, L: 0
0429 19:54:45.177730 (+ 1910us) write_op.cc:270] Start()
0429 19:54:45.177762 (+ 32us) write_op.cc:276] Timestamp: P: 1777492475419542 usec, L: 0
0429 19:54:45.179872 (+ 2110us) write_op.cc:270] Start()
0429 19:54:45.179899 (+ 27us) write_op.cc:276] Timestamp: P: 1777492475439665 usec, L: 0
0429 19:54:45.189061 (+ 9162us) write_op.cc:270] Start()
0429 19:54:45.189100 (+ 39us) write_op.cc:276] Timestamp: P: 1777492475464567 usec, L: 0
0429 19:54:45.189338 (+ 238us) write_op.cc:270] Start()
0429 19:54:45.189366 (+ 28us) write_op.cc:276] Timestamp: P: 1777492475502207 usec, L: 0
0429 19:54:45.193249 (+ 3883us) write_op.cc:270] Start()
0429 19:54:45.193298 (+ 49us) write_op.cc:276] Timestamp: P: 1777492475503532 usec, L: 0
0429 19:54:45.193460 (+ 162us) write_op.cc:270] Start()
0429 19:54:45.193482 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475510598 usec, L: 0
0429 19:54:45.195303 (+ 1821us) write_op.cc:270] Start()
0429 19:54:45.195370 (+ 67us) write_op.cc:276] Timestamp: P: 1777492475513054 usec, L: 0
0429 19:54:45.198334 (+ 2964us) write_op.cc:270] Start()
0429 19:54:45.198360 (+ 26us) write_op.cc:276] Timestamp: P: 1777492475541982 usec, L: 0
0429 19:54:45.198578 (+ 218us) write_op.cc:270] Start()
0429 19:54:45.198607 (+ 29us) write_op.cc:276] Timestamp: P: 1777492475578420 usec, L: 0
0429 19:54:45.198933 (+ 326us) write_op.cc:270] Start()
0429 19:54:45.198953 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475579879 usec, L: 0
0429 19:54:45.199118 (+ 165us) write_op.cc:270] Start()
0429 19:54:45.199141 (+ 23us) write_op.cc:276] Timestamp: P: 1777492475580580 usec, L: 0
0429 19:54:45.199293 (+ 152us) write_op.cc:270] Start()
0429 19:54:45.199316 (+ 23us) write_op.cc:276] Timestamp: P: 1777492475588295 usec, L: 0
0429 19:54:45.199474 (+ 158us) write_op.cc:270] Start()
0429 19:54:45.199496 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475627486 usec, L: 0
0429 19:54:45.205762 (+ 6266us) write_op.cc:270] Start()
0429 19:54:45.205793 (+ 31us) write_op.cc:276] Timestamp: P: 1777492475644272 usec, L: 0
0429 19:54:45.205980 (+ 187us) write_op.cc:270] Start()
0429 19:54:45.210241 (+ 4261us) write_op.cc:276] Timestamp: P: 1777492475646689 usec, L: 0
0429 19:54:45.227522 (+ 17281us) write_op.cc:270] Start()
0429 19:54:45.227553 (+ 31us) write_op.cc:276] Timestamp: P: 1777492475650479 usec, L: 0
0429 19:54:45.230245 (+ 2692us) write_op.cc:270] Start()
0429 19:54:45.230275 (+ 30us) write_op.cc:276] Timestamp: P: 1777492475690180 usec, L: 0
0429 19:54:45.232084 (+ 1809us) write_op.cc:270] Start()
0429 19:54:45.232113 (+ 29us) write_op.cc:276] Timestamp: P: 1777492475706608 usec, L: 0
0429 19:54:45.241289 (+ 9176us) write_op.cc:270] Start()
0429 19:54:45.241326 (+ 37us) write_op.cc:276] Timestamp: P: 1777492475729906 usec, L: 0
0429 19:54:45.245559 (+ 4233us) write_op.cc:270] Start()
0429 19:54:45.245601 (+ 42us) write_op.cc:276] Timestamp: P: 1777492475733964 usec, L: 0
0429 19:54:45.247269 (+ 1668us) write_op.cc:270] Start()
0429 19:54:45.247325 (+ 56us) write_op.cc:276] Timestamp: P: 1777492475745292 usec, L: 0
0429 19:54:45.251130 (+ 3805us) write_op.cc:270] Start()
0429 19:54:45.251179 (+ 49us) write_op.cc:276] Timestamp: P: 1777492475774143 usec, L: 0
0429 19:54:45.253453 (+ 2274us) write_op.cc:270] Start()
0429 19:54:45.253489 (+ 36us) write_op.cc:276] Timestamp: P: 1777492475798760 usec, L: 0
0429 19:54:45.261010 (+ 7521us) write_op.cc:270] Start()
0429 19:54:45.261040 (+ 30us) write_op.cc:276] Timestamp: P: 1777492475801279 usec, L: 0
0429 19:54:45.262897 (+ 1857us) write_op.cc:270] Start()
0429 19:54:45.263024 (+ 127us) write_op.cc:276] Timestamp: P: 1777492475831981 usec, L: 0
0429 19:54:45.273944 (+ 10920us) write_op.cc:270] Start()
0429 19:54:45.273982 (+ 38us) write_op.cc:276] Timestamp: P: 1777492475841623 usec, L: 0
0429 19:54:45.279102 (+ 5120us) write_op.cc:270] Start()
0429 19:54:45.279140 (+ 38us) write_op.cc:276] Timestamp: P: 1777492475865669 usec, L: 0
0429 19:54:45.279436 (+ 296us) write_op.cc:270] Start()
0429 19:54:45.279461 (+ 25us) write_op.cc:276] Timestamp: P: 1777492475868653 usec, L: 0
0429 19:54:45.279627 (+ 166us) write_op.cc:270] Start()
0429 19:54:45.279653 (+ 26us) write_op.cc:276] Timestamp: P: 1777492475920557 usec, L: 0
0429 19:54:45.279827 (+ 174us) write_op.cc:270] Start()
0429 19:54:45.279847 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475951042 usec, L: 0
0429 19:54:45.280013 (+ 166us) write_op.cc:270] Start()
0429 19:54:45.280071 (+ 58us) write_op.cc:276] Timestamp: P: 1777492475961868 usec, L: 0
0429 19:54:45.280247 (+ 176us) write_op.cc:270] Start()
0429 19:54:45.280272 (+ 25us) write_op.cc:276] Timestamp: P: 1777492475964621 usec, L: 0
0429 19:54:45.280432 (+ 160us) write_op.cc:270] Start()
0429 19:54:45.280453 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475965649 usec, L: 0
0429 19:54:45.280654 (+ 201us) write_op.cc:270] Start()
0429 19:54:45.280677 (+ 23us) write_op.cc:276] Timestamp: P: 1777492476002208 usec, L: 0
0429 19:54:45.280842 (+ 165us) write_op.cc:270] Start()
0429 19:54:45.280862 (+ 20us) write_op.cc:276] Timestamp: P: 1777492476017482 usec, L: 0
0429 19:54:45.281031 (+ 169us) write_op.cc:270] Start()
0429 19:54:45.281051 (+ 20us) write_op.cc:276] Timesta
I20260429 19:54:46.641559 11350 rpcz_store.cc:276] 0429 19:54:44.478546 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 19:54:44.482442 (+ 3896us) service_pool.cc:225] Handling call
0429 19:54:44.626794 (+144352us) raft_consensus.cc:1471] Updating replica for 612 ops
0429 19:54:44.765976 (+139182us) raft_consensus.cc:1534] Early marking committed up to index 0
0429 19:54:44.765987 (+ 11us) raft_consensus.cc:1539] Triggering prepare for 612 ops
0429 19:54:44.766426 (+ 439us) write_op.cc:270] Start()
0429 19:54:44.766475 (+ 49us) write_op.cc:276] Timestamp: P: 1777492472362163 usec, L: 0
0429 19:54:44.778965 (+ 12490us) write_op.cc:270] Start()
0429 19:54:44.778992 (+ 27us) write_op.cc:276] Timestamp: P: 1777492472372433 usec, L: 0
0429 19:54:44.936253 (+157261us) write_op.cc:270] Start()
0429 19:54:44.936288 (+ 35us) write_op.cc:276] Timestamp: P: 1777492473033606 usec, L: 0
0429 19:54:45.008495 (+ 72207us) write_op.cc:270] Start()
0429 19:54:45.008518 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473045751 usec, L: 0
0429 19:54:45.009753 (+ 1235us) write_op.cc:270] Start()
0429 19:54:45.009773 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473071667 usec, L: 0
0429 19:54:45.010982 (+ 1209us) write_op.cc:270] Start()
0429 19:54:45.011008 (+ 26us) write_op.cc:276] Timestamp: P: 1777492473077998 usec, L: 0
0429 19:54:45.011160 (+ 152us) write_op.cc:270] Start()
0429 19:54:45.011231 (+ 71us) write_op.cc:276] Timestamp: P: 1777492473079649 usec, L: 0
0429 19:54:45.011393 (+ 162us) write_op.cc:270] Start()
0429 19:54:45.011416 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473105051 usec, L: 0
0429 19:54:45.011563 (+ 147us) write_op.cc:270] Start()
0429 19:54:45.011585 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473124886 usec, L: 0
0429 19:54:45.011729 (+ 144us) write_op.cc:270] Start()
0429 19:54:45.011749 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473157203 usec, L: 0
0429 19:54:45.011895 (+ 146us) write_op.cc:270] Start()
0429 19:54:45.011914 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473161172 usec, L: 0
0429 19:54:45.012065 (+ 151us) write_op.cc:270] Start()
0429 19:54:45.012085 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473165051 usec, L: 0
0429 19:54:45.015154 (+ 3069us) write_op.cc:270] Start()
0429 19:54:45.015180 (+ 26us) write_op.cc:276] Timestamp: P: 1777492473182344 usec, L: 0
0429 19:54:45.015353 (+ 173us) write_op.cc:270] Start()
0429 19:54:45.015374 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473197705 usec, L: 0
0429 19:54:45.015517 (+ 143us) write_op.cc:270] Start()
0429 19:54:45.015537 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473202539 usec, L: 0
0429 19:54:45.015700 (+ 163us) write_op.cc:270] Start()
0429 19:54:45.015737 (+ 37us) write_op.cc:276] Timestamp: P: 1777492473216989 usec, L: 0
0429 19:54:45.015893 (+ 156us) write_op.cc:270] Start()
0429 19:54:45.015926 (+ 33us) write_op.cc:276] Timestamp: P: 1777492473230114 usec, L: 0
0429 19:54:45.016095 (+ 169us) write_op.cc:270] Start()
0429 19:54:45.016116 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473264688 usec, L: 0
0429 19:54:45.016283 (+ 167us) write_op.cc:270] Start()
0429 19:54:45.016306 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473274008 usec, L: 0
0429 19:54:45.016514 (+ 208us) write_op.cc:270] Start()
0429 19:54:45.016534 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473285430 usec, L: 0
0429 19:54:45.016681 (+ 147us) write_op.cc:270] Start()
0429 19:54:45.016704 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473301422 usec, L: 0
0429 19:54:45.016849 (+ 145us) write_op.cc:270] Start()
0429 19:54:45.016869 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473316859 usec, L: 0
0429 19:54:45.017035 (+ 166us) write_op.cc:270] Start()
0429 19:54:45.017056 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473349190 usec, L: 0
0429 19:54:45.017188 (+ 132us) write_op.cc:270] Start()
0429 19:54:45.017206 (+ 18us) write_op.cc:276] Timestamp: P: 1777492473359275 usec, L: 0
0429 19:54:45.017377 (+ 171us) write_op.cc:270] Start()
0429 19:54:45.017398 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473362871 usec, L: 0
0429 19:54:45.041334 (+ 23936us) write_op.cc:270] Start()
0429 19:54:45.041384 (+ 50us) write_op.cc:276] Timestamp: P: 1777492473382511 usec, L: 0
0429 19:54:45.052385 (+ 11001us) write_op.cc:270] Start()
0429 19:54:45.052418 (+ 33us) write_op.cc:276] Timestamp: P: 1777492473398656 usec, L: 0
0429 19:54:45.053942 (+ 1524us) write_op.cc:270] Start()
0429 19:54:45.053971 (+ 29us) write_op.cc:276] Timestamp: P: 1777492473422375 usec, L: 0
0429 19:54:45.054806 (+ 835us) write_op.cc:270] Start()
0429 19:54:45.054832 (+ 26us) write_op.cc:276] Timestamp: P: 1777492473437094 usec, L: 0
0429 19:54:45.056893 (+ 2061us) write_op.cc:270] Start()
0429 19:54:45.056922 (+ 29us) write_op.cc:276] Timestamp: P: 1777492473463259 usec, L: 0
0429 19:54:45.062587 (+ 5665us) write_op.cc:270] Start()
0429 19:54:45.062621 (+ 34us) write_op.cc:276] Timestamp: P: 1777492473463882 usec, L: 0
0429 19:54:45.074445 (+ 11824us) write_op.cc:270] Start()
0429 19:54:45.074485 (+ 40us) write_op.cc:276] Timestamp: P: 1777492473478848 usec, L: 0
0429 19:54:45.077028 (+ 2543us) write_op.cc:270] Start()
0429 19:54:45.077054 (+ 26us) write_op.cc:276] Timestamp: P: 1777492473480280 usec, L: 0
0429 19:54:45.077253 (+ 199us) write_op.cc:270] Start()
0429 19:54:45.077275 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473509638 usec, L: 0
0429 19:54:45.077424 (+ 149us) write_op.cc:270] Start()
0429 19:54:45.077443 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473511518 usec, L: 0
0429 19:54:45.077585 (+ 142us) write_op.cc:270] Start()
0429 19:54:45.077604 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473519756 usec, L: 0
0429 19:54:45.077766 (+ 162us) write_op.cc:270] Start()
0429 19:54:45.077808 (+ 42us) write_op.cc:276] Timestamp: P: 1777492473527341 usec, L: 0
0429 19:54:45.077979 (+ 171us) write_op.cc:270] Start()
0429 19:54:45.078000 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473552418 usec, L: 0
0429 19:54:45.078140 (+ 140us) write_op.cc:270] Start()
0429 19:54:45.078159 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473564325 usec, L: 0
0429 19:54:45.083627 (+ 5468us) write_op.cc:270] Start()
0429 19:54:45.083652 (+ 25us) write_op.cc:276] Timestamp: P: 1777492473583415 usec, L: 0
0429 19:54:45.088949 (+ 5297us) write_op.cc:270] Start()
0429 19:54:45.088971 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473597027 usec, L: 0
0429 19:54:45.090711 (+ 1740us) write_op.cc:270] Start()
0429 19:54:45.090737 (+ 26us) write_op.cc:276] Timestamp: P: 1777492473597635 usec, L: 0
0429 19:54:45.092260 (+ 1523us) write_op.cc:270] Start()
0429 19:54:45.092283 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473614697 usec, L: 0
0429 19:54:45.096237 (+ 3954us) write_op.cc:270] Start()
0429 19:54:45.096263 (+ 26us) write_op.cc:276] Timestamp: P: 1777492473633800 usec, L: 0
0429 19:54:45.108713 (+ 12450us) write_op.cc:270] Start()
0429 19:54:45.108751 (+ 38us) write_op.cc:276] Timestamp: P: 1777492473659984 usec, L: 0
0429 19:54:45.131065 (+ 22314us) write_op.cc:270] Start()
0429 19:54:45.131104 (+ 39us) write_op.cc:276] Timestamp: P: 1777492473661129 usec, L: 0
0429 19:54:45.131303 (+ 199us) write_op.cc:270] Start()
0429 19:54:45.131325 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473677647 usec, L: 0
0429 19:54:45.143551 (+ 12226us) write_op.cc:270] Start()
0429 19:54:45.143588 (+ 37us) write_op.cc:276] Timestamp: P: 1777492473691172 usec, L: 0
0429 19:54:45.143803 (+ 215us) write_op.cc:270] Start()
0429 19:54:45.143829 (+ 26us) write_op.cc:276] Timestamp: P: 1777492473701200 usec, L: 0
0429 19:54:45.144009 (+ 180us) write_op.cc:270] Start()
0429 19:54:45.144031 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473720409 usec, L: 0
0429 19:54:45.145457 (+ 1426us) write_op.cc:270] Start()
0429 19:54:45.145483 (+ 26us) write_op.cc:276] Timestamp: P: 1777492473727822 usec, L: 0
0429 19:54:45.145643 (+ 160us) write_op.cc:270] Start()
0429 19:54:45.145664 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473736003 usec, L: 0
0429 19:54:45.145815 (+ 151us) write_op.cc:270] Start()
0429 19:54:45.145834 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473751518 usec, L: 0
0429 19:54:45.146095 (+ 261us) write_op.cc:270] Start()
0429 19:54:45.146127 (+ 32us) write_op.cc:276] Timestamp: P: 1777492473772512 usec, L: 0
0429 19:54:45.146318 (+ 191us) write_op.cc:270] Start()
0429 19:54:45.146340 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473792262 usec, L: 0
0429 19:54:45.146523 (+ 183us) write_op.cc:270] Start()
0429 19:54:45.146543 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473797108 usec, L: 0
0429 19:54:45.146689 (+ 146us) write_op.cc:270] Start()
0429 19:54:45.146708 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473817679 usec, L: 0
0429 19:54:45.164138 (+ 17430us) write_op.cc:270] Start()
0429 19:54:45.164174 (+ 36us) write_op.cc:276] Timestamp: P: 1777492473822325 usec, L: 0
0429 19:54:45.167418 (+ 3244us) write_op.cc:270] Start()
0429 19:54:45.167446 (+ 28us) write_op.cc:276] Timestamp: P: 1777492473844396 usec, L: 0
0429 19:54:45.167621 (+ 175us) write_op.cc:270] Start()
0429 19:54:45.169965 (+ 2344us) write_op.cc:276] Timestamp: P: 1777492473861633 usec, L: 0
0429 19:54:45.173434 (+ 3469us) write_op.cc:270] Start()
0429 19:54:45.173459 (+ 25us) write_op.cc:276] Timestamp: P: 1777492473894784 usec, L: 0
0429 19:54:45.175566 (+ 2107us) write_op.cc:270] Start()
0429 19:54:45.175596 (+ 30us) write_op.cc:276] Timestamp: P: 1777492473896150 usec, L: 0
0429 19:54:45.179415 (+ 3819us) write_op.cc:270] Start()
0429 19:54:45.179442 (+ 27us) write_op.cc:276] Timestamp: P: 1777492473908395 usec, L: 0
0429 19:54:45.189953 (+ 10511us) write_op.cc:270] Start()
0429 19:54:45.189982 (+ 29us) write_op.cc:276] Timestamp: P: 1777492473928805 usec, L: 0
0429 19:54:45.192167 (+ 2185us) write_op.cc:270] Start()
0429 19:54:45.192195 (+ 28us) write_op.cc:276] Timestamp: P: 1777492473947711 usec, L: 0
0429 19:54:45.192397 (+ 202us) write_op.cc:270] Start()
0429 19:54:45.192421 (+ 24us) write_op.cc:276] Timestamp: P: 1777492473949528 usec, L: 0
0429 19:54:45.192576 (+ 155us) write_op.cc:270] Start()
0429 19:54:45.192595 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473988087 usec, L: 0
0429 19:54:45.192750 (+ 155us) write_op.cc:270] Start()
0429 19:54:45.192770 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473989232 usec, L: 0
0429 19:54:45.193053 (+ 283us) write_op.cc:270] Start()
0429 19:54:45.193080 (+ 27us) write_op.cc:276] Timestamp: P: 1777492474009120 usec, L: 0
0429 19:54:45.193284 (+ 204us) write_op.cc:270] Start()
0429 19:54:45.193309 (+ 25us) write_op.cc:276] Timestamp: P: 1777492474009986 usec, L: 0
0429 19:54:45.193462 (+ 153us) write_op.cc:270] Start()
0429 19:54:45.193483 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474031662 usec, L: 0
0429 19:54:45.193644 (+ 161us) write_op.cc:270] Start()
0429 19:54:45.193665 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474035611 usec, L: 0
0429 19:54:45.193804 (+ 139us) write_op.cc:270] Start()
0429 19:54:45.193824 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474064549 usec, L: 0
0429 19:54:45.193981 (+ 157us) write_op.cc:270] Start()
0429 19:54:45.194001 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474073446 usec, L: 0
0429 19:54:45.194142 (+ 141us) write_op.cc:270] Start()
0429 19:54:45.194161 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474084357 usec, L: 0
0429 19:54:45.194347 (+ 186us) write_op.cc:270] Start()
0429 19:54:45.194369 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474109644 usec, L: 0
0429 19:54:45.204585 (+ 10216us) write_op.cc:270] Start()
0429 19:54:45.204623 (+ 38us) write_op.cc:276] Timestamp: P: 1777492474117195 usec, L: 0
0429 19:54:45.204798 (+ 175us) write_op.cc:270] Start()
0429 19:54:45.204815 (+ 17us) write_op.cc:276] Timestamp: P: 1777492474144122 usec, L: 0
0429 19:54:45.212509 (+ 7694us) write_op.cc:270] Start()
0429 19:54:45.212587 (+ 78us) write_op.cc:276] Timestamp: P: 1777492474151731 usec, L: 0
0429 19:54:45.213136 (+ 549us) write_op.cc:270] Start()
0429 19:54:45.213163 (+ 27us) write_op.cc:276] Timestamp: P: 1777492474177790 usec, L: 0
0429 19:54:45.213362 (+ 199us) write_op.cc:270] Start()
0429 19:54:45.213384 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474187425 usec, L: 0
0429 19:54:45.213705 (+ 321us) write_op.cc:270] Start()
0429 19:54:45.213728 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474241570 usec, L: 0
0429 19:54:45.260839 (+ 47111us) write_op.cc:270] Start()
0429 19:54:45.260875 (+ 36us) write_op.cc:276] Timestamp: P: 1777492474242912 usec, L: 0
0429 19:54:45.266586 (+ 5711us) write_op.cc:270] Start()
0429 19:54:45.266621 (+ 35us) write_op.cc:276] Timestamp: P: 1777492474255705 usec, L: 0
0429 19:54:45.267610 (+ 989us) write_op.cc:270] Start()
0429 19:54:45.267647 (+ 37us) write_op.cc:276] Timestamp: P: 1777492474256380 usec, L: 0
0429 19:54:45.270855 (+ 3208us) write_op.cc:270] Start()
0429 19:54:45.270889 (+ 34us) write_op.cc:276] Timestamp: P: 1777492474294569 usec, L: 0
0429 19:54:45.289570 (+ 18681us) write_op.cc:270] Start()
0429 19:54:45.289591 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474313461 usec, L: 0
0429 19:54:45.289727 (+ 136us) write_op.cc:270] Start()
0429 19:54:45.289744 (+ 17us) write_op.cc:276] Timestamp: P: 1777492474320316 usec, L: 0
0429 19:54:45.289898 (+ 154us) write_op.cc:270] Start()
0429 19:54:45.289918 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474343348 usec, L: 0
0429 19:54:45.290080 (+ 162us) write_op.cc:270] Start()
0429 19:54:45.290099 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474353767 usec, L: 0
0429 19:54:45.290318 (+ 219us) write_op.cc:270] Start()
0429 19:54:45.290341 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474372655 usec, L: 0
0429 19:54:45.290513 (+ 172us) write_op.cc:270] Start()
0429 19:54:45.290533 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474406944 usec, L: 0
0429 19:54:45.290697 (+ 164us) write_op.cc:270] Start()
0429 19:54:45.290717 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474411223 usec, L: 0
0429 19:54:45.294516 (+ 3799us) write_op.cc:270] Start()
0429 19:54:45.294547 (+ 31us) write_op.cc:276] Timestamp: P: 1777492474431327 usec, L: 0
0429 19:54:45.304416 (+ 9869us) write_op.cc:270] Start()
0429 19:54:45.304438 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474437764 usec, L: 0
0429 19:54:45.308171 (+ 3733us) write_op.cc:270] Start()
0429 19:54:45.308196 (+ 25us) write_op.cc:276] Timestamp: P: 1777492474460304 usec, L: 0
0429 19:54:45.308412 (+ 216us) write_op.cc:270] Start()
0429 19:54:45.308434 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474478985 usec, L: 0
0429 19:54:45.308718 (+ 284us) write_op.cc:270] Start()
0429 19:54:45.308738 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474487983 usec, L: 0
0429 19:54:45.309201 (+ 463us) write_op.cc:270] Start()
0429 19:54:45.309251 (+ 50us) write_op.cc:276] Timestamp: P: 1777492474508417 usec, L: 0
0429 19:54:45.309692 (+ 441us) write_op.cc:270] Start()
0429 19:54:45.309712 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474545984 usec, L: 0
0429 19:54:45.310077 (+ 365us) write_op.cc:270] Start()
0429 19:54:45.310097 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474560057 usec, L: 0
0429 19:54:45.310528 (+ 431us) write_op.cc:270] Start()
0429 19:54:45.310548 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474561015 usec, L: 0
0429 19:54:45.310996 (+ 448us) write_op.cc:270] Start()
0429 19:54:45.311031 (+ 35us) write_op.cc:276] Timestamp: P: 1777492474575840 usec, L: 0
0429 19:54:45.312571 (+ 1540us) write_op.cc:270] Start()
0429 19:54:45.313728 (+ 1157us) write_op.cc:276] Timestamp: P: 1777492474591714 usec, L: 0
0429 19:54:45.314303 (+ 575us) write_op.cc:270] Start()
0429 19:54:45.314327 (+ 24us) write_op.cc:276] Timestamp: P: 1777492474616723 usec, L: 0
0429 19:54:45.314515 (+ 188us) write_op.cc:270] Start()
0429 19:54:45.314537 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474632085 usec, L: 0
0429 19:54:45.314696 (+ 159us) write_op.cc:270] Start()
0429 19:54:45.314717 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474634191 usec, L: 0
0429 19:54:45.314903 (+ 186us) write_op.cc:270] Start()
0429 19:54:45.314924 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474650678 usec, L: 0
0429 19:54:45.315094 (+ 170us) write_op.cc:270] Start()
0429 19:54:45.315116 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474678847 usec, L: 0
0429 19:54:45.315266 (+ 150us) write_op.cc:270] Start()
0429 19:54:45.315287 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474706458 usec, L: 0
0429 19:54:45.315439 (+ 152us) write_op.cc:270] Start()
0429 19:54:45.315460 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474707212 usec, L: 0
0429 19:54:45.315603 (+ 143us) write_op.cc:270] Start()
0429 19:54:45.315623 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474710666 usec, L: 0
0429 19:54:45.315796 (+ 173us) write_op.cc:270] Start()
0429 19:54:45.315817 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474730380 usec, L: 0
0429 19:54:45.315969 (+ 152us) write_op.cc:270] Start()
0429 19:54:45.315990 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474744686 usec, L: 0
0429 19:54:45.316149 (+ 159us) write_op.cc:270] Start()
0429 19:54:45.316186 (+ 37us) write_op.cc:276] Timestamp: P: 1777492474756793 usec, L: 0
0429 19:54:45.316335 (+ 149us) write_op.cc:270] Start()
0429 19:54:45.316355 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474769248 usec, L: 0
0429 19:54:45.316500 (+ 145us) write_op.cc:270] Start()
0429 19:54:45.316519 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474774217 usec, L: 0
0429 19:54:45.316700 (+ 181us) write_op.cc:270] Start()
0429 19:54:45.316720 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474808003 usec, L: 0
0429 19:54:45.316858 (+ 138us) write_op.cc:270] Start()
0429 19:54:45.316876 (+ 18us) write_op.cc:276] Timestamp: P: 1777492474817362 usec, L: 0
0429 19:54:45.317015 (+ 139us) write_op.cc:270] Start()
0429 19:54:45.317036 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474833232 usec, L: 0
0429 19:54:45.317202 (+ 166us) write_op.cc:270] Start()
0429 19:54:45.317223 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474866520 usec, L: 0
0429 19:54:45.331997 (+ 14774us) write_op.cc:270] Start()
0429 19:54:45.332035 (+ 38us) write_op.cc:276] Timestamp: P: 1777492474867388 usec, L: 0
0429 19:54:45.333479 (+ 1444us) write_op.cc:270] Start()
0429 19:54:45.333502 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474869847 usec, L: 0
0429 19:54:45.333789 (+ 287us) write_op.cc:270] Start()
0429 19:54:45.333812 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474881887 usec, L: 0
0429 19:54:45.333964 (+ 152us) write_op.cc:270] Start()
0429 19:54:45.333986 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474923460 usec, L: 0
0429 19:54:45.334160 (+ 174us) write_op.cc:270] Start()
0429 19:54:45.334182 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474946511 usec, L: 0
0429 19:54:45.336245 (+ 2063us) write_op.cc:270] Start()
0429 19:54:45.336277 (+ 32us) write_op.cc:276] Timestamp: P: 1777492474947651 usec, L: 0
0429 19:54:45.336496 (+ 219us) write_op.cc:270] Start()
0429 19:54:45.336518 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474949377 usec, L: 0
0429 19:54:45.336705 (+ 187us) write_op.cc:270] Start()
0429 19:54:45.336727 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474978062 usec, L: 0
0429 19:54:45.336884 (+ 157us) write_op.cc:270] Start()
0429 19:54:45.336904 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475006012 usec, L: 0
0429 19:54:45.360553 (+ 23649us) write_op.cc:270] Start()
0429 19:54:45.360625 (+ 72us) write_op.cc:276] Timestamp: P: 1777492475009082 usec, L: 0
0429 19:54:45.360848 (+ 223us) write_op.cc:270] Start()
0429 19:54:45.360872 (+ 24us) write_op.cc:276] Timestamp: P: 1777492475012093 usec, L: 0
0429 19:54:45.361097 (+ 225us) write_op.cc:270] Start()
0429 19:54:45.361119 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475025065 usec, L: 0
0429 19:54:45.361318 (+ 199us) write_op.cc:270] Start()
0429 19:54:45.361340 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475044793 usec, L: 0
0429 19:54:45.361526 (+ 186us) write_op.cc:270] Start()
0429 19:54:45.361548 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475070115 usec, L: 0
0429 19:54:45.366151 (+ 4603us) write_op.cc:270] Start()
0429 19:54:45.366179 (+ 28us) write_op.cc:276] Timestamp: P: 1777492475071641 usec, L: 0
0429 19:54:45.366857 (+ 678us) write_op.cc:270] Start()
0429 19:54:45.366883 (+ 26us) write_op.cc:276] Timestamp: P: 1777492475082488 usec, L: 0
0429 19:54:45.367132 (+ 249us) write_op.cc:270] Start()
0429 19:54:45.367163 (+ 31us) write_op.cc:276] Timestamp: P: 1777492475112237 usec, L: 0
0429 19:54:45.367361 (+ 198us) write_op.cc:270] Start()
0429 19:54:45.367385 (+ 24us) write_op.cc:276] Timestamp: P: 1777492475114318 usec, L: 0
0429 19:54:45.367581 (+ 196us) write_op.cc:270] Start()
0429 19:54:45.367602 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475140731 usec, L: 0
0429 19:54:45.367786 (+ 184us) write_op.cc:270] Start()
0429 19:54:45.367807 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475143152 usec, L: 0
0429 19:54:45.367987 (+ 180us) write_op.cc:270] Start()
0429 19:54:45.368020 (+ 33us) write_op.cc:276] Timestamp: P: 1777492475173341 usec, L: 0
0429 19:54:45.368243 (+ 223us) write_op.cc:270] Start()
0429 19:54:45.368267 (+ 24us) write_op.cc:276] Timestamp: P: 1777492475181290 usec, L: 0
0429 19:54:45.368499 (+ 232us) write_op.cc:270] Start()
0429 19:54:45.368521 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475203173 usec, L: 0
0429 19:54:45.368715 (+ 194us) write_op.cc:270] Start()
0429 19:54:45.368736 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475217300 usec, L: 0
0429 19:54:45.369421 (+ 685us) write_op.cc:270] Start()
0429 19:54:45.369448 (+ 27us) write_op.cc:276] Timestamp: P: 1777492475221525 usec, L: 0
0429 19:54:45.369645 (+ 197us) write_op.cc:270] Start()
0429 19:54:45.369672 (+ 27us) write_op.cc:276] Timestamp: P: 1777492475231914 usec, L: 0
0429 19:54:45.369868 (+ 196us) write_op.cc:270] Start()
0429 19:54:45.369984 (+ 116us) write_op.cc:276] Timestamp: P: 1777492475249326 usec, L: 0
0429 19:54:45.371358 (+ 1374us) write_op.cc:270] Start()
0429 19:54:45.371385 (+ 27us) write_op.cc:276] Timestamp: P: 1777492475254198 usec, L: 0
0429 19:54:45.371557 (+ 172us) write_op.cc:270] Start()
0429 19:54:45.371576 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475274052 usec, L: 0
0429 19:54:45.373589 (+ 2013us) write_op.cc:270] Start()
0429 19:54:45.373614 (+ 25us) write_op.cc:276] Timestamp: P: 1777492475282849 usec, L: 0
0429 19:54:45.373809 (+ 195us) write_op.cc:270] Start()
0429 19:54:45.373834 (+ 25us) write_op.cc:276] Timestamp: P: 1777492475307610 usec, L: 0
0429 19:54:45.374038 (+ 204us) write_op.cc:270] Start()
0429 19:54:45.374059 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475329716 usec, L: 0
0429 19:54:45.374224 (+ 165us) write_op.cc:270] Start()
0429 19:54:45.374244 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475333955 usec, L: 0
0429 19:54:45.376695 (+ 2451us) write_op.cc:270] Start()
0429 19:54:45.376725 (+ 30us) write_op.cc:276] Timestamp: P: 1777492475336137 usec, L: 0
0429 19:54:45.376938 (+ 213us) write_op.cc:270] Start()
0429 19:54:45.376966 (+ 28us) write_op.cc:276] Timestamp: P: 1777492475372901 usec, L: 0
0429 19:54:45.377147 (+ 181us) write_op.cc:270] Start()
0429 19:54:45.377176 (+ 29us) write_op.cc:276] Timestamp: P: 1777492475407481 usec, L: 0
0429 19:54:45.377364 (+ 188us) write_op.cc:270] Start()
0429 19:54:45.377385 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475422389 usec, L: 0
0429 19:54:45.377617 (+ 232us) write_op.cc:270] Start()
0429 19:54:45.377640 (+ 23us) write_op.cc:276] Timestamp: P: 1777492475426664 usec, L: 0
0429 19:54:45.377839 (+ 199us) write_op.cc:270] Start()
0429 19:54:45.377862 (+ 23us) write_op.cc:276] Timestamp: P: 1777492475439781 usec, L: 0
0429 19:54:45.378063 (+ 201us) write_op.cc:270] Start()
0429 19:54:45.378092 (+ 29us) write_op.cc:276] Timestamp: P: 1777492475461760 usec, L: 0
0429 19:54:45.378299 (+ 207us) write_op.cc:270] Start()
0429 19:54:45.378325 (+ 26us) write_op.cc:276] Timestamp: P: 1777492475493698 usec, L: 0
0429 19:54:45.378556 (+ 231us) write_op.cc:270] Start()
0429 19:54:45.378578 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475505715 usec, L: 0
0429 19:54:45.378765 (+ 187us) write_op.cc:270] Start()
0429 19:54:45.378785 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475517929 usec, L: 0
0429 19:54:45.378976 (+ 191us) write_op.cc:270] Start()
0429 19:54:45.379001 (+ 25us) write_op.cc:276] Timestamp: P: 1777492475520349 usec, L: 0
0429 19:54:45.379189 (+ 188us) write_op.cc:270] Start()
0429 19:54:45.379210 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475541162 usec, L: 0
0429 19:54:45.379548 (+ 338us) write_op.cc:270] Start()
0429 19:54:45.379669 (+ 121us) write_op.cc:276] Timestamp: P: 1777492475588700 usec, L: 0
0429 19:54:45.387353 (+ 7684us) write_op.cc:270] Start()
0429 19:54:45.387378 (+ 25us) write_op.cc:276] Timestamp: P: 1777492475591067 usec, L: 0
0429 19:54:45.387527 (+ 149us) write_op.cc:270] Start()
0429 19:54:45.387545 (+ 18us) write_op.cc:276] Timestamp: P: 1777492475592691 usec, L: 0
0429 19:54:45.387686 (+ 141us) write_op.cc:270] Start()
0429 19:54:45.387704 (+ 18us) write_op.cc:276] Timestamp: P: 1777492475593254 usec, L: 0
0429 19:54:45.387836 (+ 132us) write_op.cc:270] Start()
0429 19:54:45.387853 (+ 17us) write_op.cc:276] Timestamp: P: 1777492475633082 usec, L: 0
0429 19:54:45.387964 (+ 111us) write_op.cc:270] Start()
0429 19:54:45.387980 (+ 16us) write_op.cc:276] Timestamp: P: 1777492475653843 usec, L: 0
0429 19:54:45.388116 (+ 136us) write_op.cc:270] Start()
0429 19:54:45.388133 (+ 17us) write_op.cc:276] Timestamp: P: 1777492475658659 usec, L: 0
0429 19:54:45.395759 (+ 7626us) write_op.cc:270] Start()
0429 19:54:45.395785 (+ 26us) write_op.cc:276] Timestamp: P: 1777492475670383 usec, L: 0
0429 19:54:45.396697 (+ 912us) write_op.cc:270] Start()
0429 19:54:45.396724 (+ 27us) write_op.cc:276] Timestamp: P: 1777492475710398 usec, L: 0
0429 19:54:45.397165 (+ 441us) write_op.cc:270] Start()
0429 19:54:45.397186 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475711593 usec, L: 0
0429 19:54:45.398874 (+ 1688us) write_op.cc:270] Start()
0429 19:54:45.398895 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475737582 usec, L: 0
0429 19:54:45.399648 (+ 753us) write_op.cc:270] Start()
0429 19:54:45.400080 (+ 432us) write_op.cc:276] Timestamp: P: 1777492475755826 usec, L: 0
0429 19:54:45.400500 (+ 420us) write_op.cc:270] Start()
0429 19:54:45.400520 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475762902 usec, L: 0
0429 19:54:45.401294 (+ 774us) write_op.cc:270] Start()
0429 19:54:45.401318 (+ 24us) write_op.cc:276] Timestamp: P: 1777492475775038 usec, L: 0
0429 19:54:45.401673 (+ 355us) write_op.cc:270] Start()
0429 19:54:45.401693 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475799405 usec, L: 0
0429 19:54:45.402134 (+ 441us) write_op.cc:270] Start()
0429 19:54:45.402157 (+ 23us) write_op.cc:276] Timestamp: P: 1777492475811355 usec, L: 0
0429 19:54:45.402808 (+ 651us) write_op.cc:270] Start()
0429 19:54:45.402831 (+ 23us) write_op.cc:276] Timestamp: P: 1777492475847646 usec, L: 0
0429 19:54:45.403255 (+ 424us) write_op.cc:270] Start()
0429 19:54:45.403277 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475857608 usec, L: 0
0429 19:54:45.406109 (+ 2832us) write_op.cc:270] Start()
0429 19:54:45.406134 (+ 25us) write_op.cc:276] Timestamp: P: 1777492475870217 usec, L: 0
0429 19:54:45.406602 (+ 468us) write_op.cc:270] Start()
0429 19:54:45.406624 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475876192 usec, L: 0
0429 19:54:45.407087 (+ 463us) write_op.cc:270] Start()
0429 19:54:45.407111 (+ 24us) write_op.cc:276] Timestamp: P: 1777492475923902 usec, L: 0
0429 19:54:45.407307 (+ 196us) write_op.cc:270] Start()
0429 19:54:45.407329 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475945480 usec, L: 0
0429 19:54:45.407477 (+ 148us) write_op.cc:270] Start()
0429 19:54:45.407499 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475956966 usec, L: 0
0429 19:54:45.407666 (+ 167us) write_op.cc:270] Start()
0429 19:54:45.407687 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475961428 usec, L: 0
0429 19:54:45.407850 (+ 163us) write_op.cc:270] Start()
0429 19:54:45.407871 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475963448 usec, L: 0
0429 19:54:45.418059 (+ 10188us) write_op.cc:270] Start()
0429 19:54:45.418085 (+ 26us) write_op.cc:276] Timestamp: P: 1777492475998287 usec, L: 0
0429 19:54:45.418759 (+ 674us) write_op.cc:270] Start()
0429 19:54:45.418781 (+ 22us) write_op.cc:276] Timestamp: P: 1777492476030084 usec, L: 0
0429 19:54:45.424235 (+ 5454us) write_op.cc:270] Start()
0429 19:54:45.424268 (+ 33us) write_op.cc:276] Timestamp: P: 1777492476031352 usec, L: 0
0429 19:54:45.424462 (+ 194us) write_op.cc:270] Start()
0429 19:54:45.424485 (+ 23us) write_op.cc:276] Timestamp: P: 1777492476032020 usec, L: 0
0429 19:54:45.424655 (+ 170us) write_op.cc:270] Start()
0429 19:54:45.424679 (+ 24us) write_op.cc:276] Timestamp: P: 1777492476047009 usec, L: 0
0429 19:54:45.424817 (+ 138us) write_op.cc:270] Start()
0429 19:54:45.424842 (+ 25us) write_op.cc:276] Timestamp: P: 17774924
I20260429 19:54:46.478826 11348 rpcz_store.cc:276] 0429 19:54:44.488729 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 19:54:44.488804 (+ 75us) service_pool.cc:225] Handling call
0429 19:54:44.634939 (+146135us) raft_consensus.cc:1471] Updating replica for 617 ops
0429 19:54:44.770471 (+135532us) raft_consensus.cc:1534] Early marking committed up to index 149
0429 19:54:44.776100 (+ 5629us) raft_consensus.cc:1539] Triggering prepare for 617 ops
0429 19:54:44.776350 (+ 250us) write_op.cc:270] Start()
0429 19:54:44.776380 (+ 30us) write_op.cc:276] Timestamp: P: 1777492472654774 usec, L: 0
0429 19:54:44.776671 (+ 291us) write_op.cc:270] Start()
0429 19:54:44.776724 (+ 53us) write_op.cc:276] Timestamp: P: 1777492472695058 usec, L: 0
0429 19:54:44.776931 (+ 207us) write_op.cc:270] Start()
0429 19:54:44.776952 (+ 21us) write_op.cc:276] Timestamp: P: 1777492472727792 usec, L: 0
0429 19:54:44.777106 (+ 154us) write_op.cc:270] Start()
0429 19:54:44.777151 (+ 45us) write_op.cc:276] Timestamp: P: 1777492473034260 usec, L: 0
0429 19:54:44.777309 (+ 158us) write_op.cc:270] Start()
0429 19:54:44.777329 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473046776 usec, L: 0
0429 19:54:44.777472 (+ 143us) write_op.cc:270] Start()
0429 19:54:44.777498 (+ 26us) write_op.cc:276] Timestamp: P: 1777492473074804 usec, L: 0
0429 19:54:44.777657 (+ 159us) write_op.cc:270] Start()
0429 19:54:44.777693 (+ 36us) write_op.cc:276] Timestamp: P: 1777492473096337 usec, L: 0
0429 19:54:44.777835 (+ 142us) write_op.cc:270] Start()
0429 19:54:44.777854 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473097058 usec, L: 0
0429 19:54:44.777990 (+ 136us) write_op.cc:270] Start()
0429 19:54:44.778010 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473110195 usec, L: 0
0429 19:54:44.778180 (+ 170us) write_op.cc:270] Start()
0429 19:54:44.778201 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473145430 usec, L: 0
0429 19:54:44.778342 (+ 141us) write_op.cc:270] Start()
0429 19:54:44.778361 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473161194 usec, L: 0
0429 19:54:44.778517 (+ 156us) write_op.cc:270] Start()
0429 19:54:44.778538 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473162040 usec, L: 0
0429 19:54:44.778706 (+ 168us) write_op.cc:270] Start()
0429 19:54:44.778728 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473165607 usec, L: 0
0429 19:54:44.778876 (+ 148us) write_op.cc:270] Start()
0429 19:54:44.778896 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473178783 usec, L: 0
0429 19:54:44.779060 (+ 164us) write_op.cc:270] Start()
0429 19:54:44.779081 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473201145 usec, L: 0
0429 19:54:44.779246 (+ 165us) write_op.cc:270] Start()
0429 19:54:44.779272 (+ 26us) write_op.cc:276] Timestamp: P: 1777492473205014 usec, L: 0
0429 19:54:44.779453 (+ 181us) write_op.cc:270] Start()
0429 19:54:44.779477 (+ 24us) write_op.cc:276] Timestamp: P: 1777492473218329 usec, L: 0
0429 19:54:44.779628 (+ 151us) write_op.cc:270] Start()
0429 19:54:44.779650 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473228128 usec, L: 0
0429 19:54:44.789838 (+ 10188us) write_op.cc:270] Start()
0429 19:54:44.789880 (+ 42us) write_op.cc:276] Timestamp: P: 1777492473264863 usec, L: 0
0429 19:54:44.790087 (+ 207us) write_op.cc:270] Start()
0429 19:54:44.790139 (+ 52us) write_op.cc:276] Timestamp: P: 1777492473266827 usec, L: 0
0429 19:54:44.790317 (+ 178us) write_op.cc:270] Start()
0429 19:54:44.790336 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473270229 usec, L: 0
0429 19:54:44.790484 (+ 148us) write_op.cc:270] Start()
0429 19:54:44.790501 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473301216 usec, L: 0
0429 19:54:44.790628 (+ 127us) write_op.cc:270] Start()
0429 19:54:44.795576 (+ 4948us) write_op.cc:276] Timestamp: P: 1777492473316899 usec, L: 0
0429 19:54:44.795804 (+ 228us) write_op.cc:270] Start()
0429 19:54:44.795832 (+ 28us) write_op.cc:276] Timestamp: P: 1777492473346549 usec, L: 0
0429 19:54:44.795995 (+ 163us) write_op.cc:270] Start()
0429 19:54:44.796013 (+ 18us) write_op.cc:276] Timestamp: P: 1777492473353701 usec, L: 0
0429 19:54:44.796175 (+ 162us) write_op.cc:270] Start()
0429 19:54:44.796194 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473363373 usec, L: 0
0429 19:54:44.796311 (+ 117us) write_op.cc:270] Start()
0429 19:54:44.796328 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473383363 usec, L: 0
0429 19:54:44.796476 (+ 148us) write_op.cc:270] Start()
0429 19:54:44.796492 (+ 16us) write_op.cc:276] Timestamp: P: 1777492473416154 usec, L: 0
0429 19:54:44.796615 (+ 123us) write_op.cc:270] Start()
0429 19:54:44.796633 (+ 18us) write_op.cc:276] Timestamp: P: 1777492473430928 usec, L: 0
0429 19:54:44.796774 (+ 141us) write_op.cc:270] Start()
0429 19:54:44.796791 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473437157 usec, L: 0
0429 19:54:44.796906 (+ 115us) write_op.cc:270] Start()
0429 19:54:44.796923 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473462134 usec, L: 0
0429 19:54:44.797051 (+ 128us) write_op.cc:270] Start()
0429 19:54:44.797069 (+ 18us) write_op.cc:276] Timestamp: P: 1777492473467152 usec, L: 0
0429 19:54:44.797249 (+ 180us) write_op.cc:270] Start()
0429 19:54:44.797267 (+ 18us) write_op.cc:276] Timestamp: P: 1777492473478103 usec, L: 0
0429 19:54:44.797399 (+ 132us) write_op.cc:270] Start()
0429 19:54:44.797417 (+ 18us) write_op.cc:276] Timestamp: P: 1777492473483853 usec, L: 0
0429 19:54:44.797534 (+ 117us) write_op.cc:270] Start()
0429 19:54:44.797550 (+ 16us) write_op.cc:276] Timestamp: P: 1777492473511939 usec, L: 0
0429 19:54:44.797686 (+ 136us) write_op.cc:270] Start()
0429 19:54:44.797751 (+ 65us) write_op.cc:276] Timestamp: P: 1777492473518489 usec, L: 0
0429 19:54:44.797889 (+ 138us) write_op.cc:270] Start()
0429 19:54:44.797906 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473528585 usec, L: 0
0429 19:54:44.798052 (+ 146us) write_op.cc:270] Start()
0429 19:54:44.798068 (+ 16us) write_op.cc:276] Timestamp: P: 1777492473531857 usec, L: 0
0429 19:54:44.798204 (+ 136us) write_op.cc:270] Start()
0429 19:54:44.798221 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473560867 usec, L: 0
0429 19:54:44.798360 (+ 139us) write_op.cc:270] Start()
0429 19:54:44.798380 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473562537 usec, L: 0
0429 19:54:44.807177 (+ 8797us) write_op.cc:270] Start()
0429 19:54:44.807214 (+ 37us) write_op.cc:276] Timestamp: P: 1777492473575455 usec, L: 0
0429 19:54:44.807394 (+ 180us) write_op.cc:270] Start()
0429 19:54:44.807415 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473596318 usec, L: 0
0429 19:54:44.807555 (+ 140us) write_op.cc:270] Start()
0429 19:54:44.807574 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473598861 usec, L: 0
0429 19:54:44.807697 (+ 123us) write_op.cc:270] Start()
0429 19:54:44.807716 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473611918 usec, L: 0
0429 19:54:44.807886 (+ 170us) write_op.cc:270] Start()
0429 19:54:44.807907 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473634521 usec, L: 0
0429 19:54:44.808063 (+ 156us) write_op.cc:270] Start()
0429 19:54:44.808083 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473649846 usec, L: 0
0429 19:54:44.808227 (+ 144us) write_op.cc:270] Start()
0429 19:54:44.808246 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473662693 usec, L: 0
0429 19:54:44.808394 (+ 148us) write_op.cc:270] Start()
0429 19:54:44.808414 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473677538 usec, L: 0
0429 19:54:44.808563 (+ 149us) write_op.cc:270] Start()
0429 19:54:44.808583 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473691284 usec, L: 0
0429 19:54:44.808808 (+ 225us) write_op.cc:270] Start()
0429 19:54:44.808829 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473702135 usec, L: 0
0429 19:54:44.808997 (+ 168us) write_op.cc:270] Start()
0429 19:54:44.809017 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473727743 usec, L: 0
0429 19:54:44.809208 (+ 191us) write_op.cc:270] Start()
0429 19:54:44.809227 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473728533 usec, L: 0
0429 19:54:44.809368 (+ 141us) write_op.cc:270] Start()
0429 19:54:44.809388 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473751788 usec, L: 0
0429 19:54:44.809569 (+ 181us) write_op.cc:270] Start()
0429 19:54:44.809589 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473757785 usec, L: 0
0429 19:54:44.809761 (+ 172us) write_op.cc:270] Start()
0429 19:54:44.809780 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473770868 usec, L: 0
0429 19:54:44.809942 (+ 162us) write_op.cc:270] Start()
0429 19:54:44.809962 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473790295 usec, L: 0
0429 19:54:44.810094 (+ 132us) write_op.cc:270] Start()
0429 19:54:44.810123 (+ 29us) write_op.cc:276] Timestamp: P: 1777492473796295 usec, L: 0
0429 19:54:44.810266 (+ 143us) write_op.cc:270] Start()
0429 19:54:44.810286 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473817038 usec, L: 0
0429 19:54:44.822686 (+ 12400us) write_op.cc:270] Start()
0429 19:54:44.822724 (+ 38us) write_op.cc:276] Timestamp: P: 1777492473837869 usec, L: 0
0429 19:54:44.822973 (+ 249us) write_op.cc:270] Start()
0429 19:54:44.823021 (+ 48us) write_op.cc:276] Timestamp: P: 1777492473845766 usec, L: 0
0429 19:54:44.823292 (+ 271us) write_op.cc:270] Start()
0429 19:54:44.823324 (+ 32us) write_op.cc:276] Timestamp: P: 1777492473861036 usec, L: 0
0429 19:54:44.823507 (+ 183us) write_op.cc:270] Start()
0429 19:54:44.823538 (+ 31us) write_op.cc:276] Timestamp: P: 1777492473885822 usec, L: 0
0429 19:54:44.823716 (+ 178us) write_op.cc:270] Start()
0429 19:54:44.823739 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473895473 usec, L: 0
0429 19:54:44.823911 (+ 172us) write_op.cc:270] Start()
0429 19:54:44.823934 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473913483 usec, L: 0
0429 19:54:44.829586 (+ 5652us) write_op.cc:270] Start()
0429 19:54:44.829618 (+ 32us) write_op.cc:276] Timestamp: P: 1777492473929431 usec, L: 0
0429 19:54:44.829818 (+ 200us) write_op.cc:270] Start()
0429 19:54:44.829840 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473939522 usec, L: 0
0429 19:54:44.829989 (+ 149us) write_op.cc:270] Start()
0429 19:54:44.830010 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473949948 usec, L: 0
0429 19:54:44.830165 (+ 155us) write_op.cc:270] Start()
0429 19:54:44.830188 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473988392 usec, L: 0
0429 19:54:44.830362 (+ 174us) write_op.cc:270] Start()
0429 19:54:44.830412 (+ 50us) write_op.cc:276] Timestamp: P: 1777492473991047 usec, L: 0
0429 19:54:44.830573 (+ 161us) write_op.cc:270] Start()
0429 19:54:44.830592 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473994737 usec, L: 0
0429 19:54:44.830731 (+ 139us) write_op.cc:270] Start()
0429 19:54:44.830751 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474007006 usec, L: 0
0429 19:54:44.830888 (+ 137us) write_op.cc:270] Start()
0429 19:54:44.830907 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474032128 usec, L: 0
0429 19:54:44.831080 (+ 173us) write_op.cc:270] Start()
0429 19:54:44.831101 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474034998 usec, L: 0
0429 19:54:44.831258 (+ 157us) write_op.cc:270] Start()
0429 19:54:44.831279 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474056505 usec, L: 0
0429 19:54:44.831413 (+ 134us) write_op.cc:270] Start()
0429 19:54:44.831431 (+ 18us) write_op.cc:276] Timestamp: P: 1777492474083536 usec, L: 0
0429 19:54:44.831555 (+ 124us) write_op.cc:270] Start()
0429 19:54:44.831575 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474085032 usec, L: 0
0429 19:54:44.831758 (+ 183us) write_op.cc:270] Start()
0429 19:54:44.831779 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474100828 usec, L: 0
0429 19:54:44.831920 (+ 141us) write_op.cc:270] Start()
0429 19:54:44.831992 (+ 72us) write_op.cc:276] Timestamp: P: 1777492474117888 usec, L: 0
0429 19:54:44.832177 (+ 185us) write_op.cc:270] Start()
0429 19:54:44.832211 (+ 34us) write_op.cc:276] Timestamp: P: 1777492474151018 usec, L: 0
0429 19:54:44.832368 (+ 157us) write_op.cc:270] Start()
0429 19:54:44.832390 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474167033 usec, L: 0
0429 19:54:44.832550 (+ 160us) write_op.cc:270] Start()
0429 19:54:44.832570 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474176347 usec, L: 0
0429 19:54:44.832714 (+ 144us) write_op.cc:270] Start()
0429 19:54:44.832734 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474177161 usec, L: 0
0429 19:54:44.832876 (+ 142us) write_op.cc:270] Start()
0429 19:54:44.832896 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474232666 usec, L: 0
0429 19:54:44.833051 (+ 155us) write_op.cc:270] Start()
0429 19:54:44.833071 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474240789 usec, L: 0
0429 19:54:44.833222 (+ 151us) write_op.cc:270] Start()
0429 19:54:44.833244 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474255730 usec, L: 0
0429 19:54:44.833380 (+ 136us) write_op.cc:270] Start()
0429 19:54:44.833399 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474257339 usec, L: 0
0429 19:54:44.833547 (+ 148us) write_op.cc:270] Start()
0429 19:54:44.833566 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474288956 usec, L: 0
0429 19:54:44.833701 (+ 135us) write_op.cc:270] Start()
0429 19:54:44.833720 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474303618 usec, L: 0
0429 19:54:44.833896 (+ 176us) write_op.cc:270] Start()
0429 19:54:44.833917 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474323475 usec, L: 0
0429 19:54:44.834065 (+ 148us) write_op.cc:270] Start()
0429 19:54:44.834085 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474331910 usec, L: 0
0429 19:54:44.851828 (+ 17743us) write_op.cc:270] Start()
0429 19:54:44.851862 (+ 34us) write_op.cc:276] Timestamp: P: 1777492474356057 usec, L: 0
0429 19:54:44.871075 (+ 19213us) write_op.cc:270] Start()
0429 19:54:44.871104 (+ 29us) write_op.cc:276] Timestamp: P: 1777492474372723 usec, L: 0
0429 19:54:44.872407 (+ 1303us) write_op.cc:270] Start()
0429 19:54:44.872436 (+ 29us) write_op.cc:276] Timestamp: P: 1777492474408478 usec, L: 0
0429 19:54:44.888091 (+ 15655us) write_op.cc:270] Start()
0429 19:54:44.888120 (+ 29us) write_op.cc:276] Timestamp: P: 1777492474411211 usec, L: 0
0429 19:54:44.889051 (+ 931us) write_op.cc:270] Start()
0429 19:54:44.889076 (+ 25us) write_op.cc:276] Timestamp: P: 1777492474436716 usec, L: 0
0429 19:54:44.891266 (+ 2190us) write_op.cc:270] Start()
0429 19:54:44.891287 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474437283 usec, L: 0
0429 19:54:44.891441 (+ 154us) write_op.cc:270] Start()
0429 19:54:44.891459 (+ 18us) write_op.cc:276] Timestamp: P: 1777492474459374 usec, L: 0
0429 19:54:44.891603 (+ 144us) write_op.cc:270] Start()
0429 19:54:44.891619 (+ 16us) write_op.cc:276] Timestamp: P: 1777492474482196 usec, L: 0
0429 19:54:44.891735 (+ 116us) write_op.cc:270] Start()
0429 19:54:44.891755 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474485966 usec, L: 0
0429 19:54:44.892757 (+ 1002us) write_op.cc:270] Start()
0429 19:54:44.892784 (+ 27us) write_op.cc:276] Timestamp: P: 1777492474507169 usec, L: 0
0429 19:54:44.894151 (+ 1367us) write_op.cc:270] Start()
0429 19:54:44.894176 (+ 25us) write_op.cc:276] Timestamp: P: 1777492474546080 usec, L: 0
0429 19:54:44.898717 (+ 4541us) write_op.cc:270] Start()
0429 19:54:44.898751 (+ 34us) write_op.cc:276] Timestamp: P: 1777492474553287 usec, L: 0
0429 19:54:44.898962 (+ 211us) write_op.cc:270] Start()
0429 19:54:44.898987 (+ 25us) write_op.cc:276] Timestamp: P: 1777492474572410 usec, L: 0
0429 19:54:44.899157 (+ 170us) write_op.cc:270] Start()
0429 19:54:44.899179 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474573131 usec, L: 0
0429 19:54:44.899356 (+ 177us) write_op.cc:270] Start()
0429 19:54:44.899378 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474590137 usec, L: 0
0429 19:54:44.899515 (+ 137us) write_op.cc:270] Start()
0429 19:54:44.899534 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474619772 usec, L: 0
0429 19:54:44.899667 (+ 133us) write_op.cc:270] Start()
0429 19:54:44.899687 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474631852 usec, L: 0
0429 19:54:44.920205 (+ 20518us) write_op.cc:270] Start()
0429 19:54:44.920240 (+ 35us) write_op.cc:276] Timestamp: P: 1777492474639403 usec, L: 0
0429 19:54:44.934230 (+ 13990us) write_op.cc:270] Start()
0429 19:54:44.934250 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474651442 usec, L: 0
0429 19:54:44.938569 (+ 4319us) write_op.cc:270] Start()
0429 19:54:44.938596 (+ 27us) write_op.cc:276] Timestamp: P: 1777492474675409 usec, L: 0
0429 19:54:44.938800 (+ 204us) write_op.cc:270] Start()
0429 19:54:44.939169 (+ 369us) write_op.cc:276] Timestamp: P: 1777492474704289 usec, L: 0
0429 19:54:44.939633 (+ 464us) write_op.cc:270] Start()
0429 19:54:44.939656 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474706843 usec, L: 0
0429 19:54:44.948182 (+ 8526us) write_op.cc:270] Start()
0429 19:54:44.948220 (+ 38us) write_op.cc:276] Timestamp: P: 1777492474709976 usec, L: 0
0429 19:54:44.948950 (+ 730us) write_op.cc:270] Start()
0429 19:54:44.948990 (+ 40us) write_op.cc:276] Timestamp: P: 1777492474732855 usec, L: 0
0429 19:54:44.950781 (+ 1791us) write_op.cc:270] Start()
0429 19:54:44.950807 (+ 26us) write_op.cc:276] Timestamp: P: 1777492474745182 usec, L: 0
0429 19:54:44.950980 (+ 173us) write_op.cc:270] Start()
0429 19:54:44.951001 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474756178 usec, L: 0
0429 19:54:44.952982 (+ 1981us) write_op.cc:270] Start()
0429 19:54:44.953007 (+ 25us) write_op.cc:276] Timestamp: P: 1777492474776685 usec, L: 0
0429 19:54:44.968939 (+ 15932us) write_op.cc:270] Start()
0429 19:54:44.968992 (+ 53us) write_op.cc:276] Timestamp: P: 1777492474777481 usec, L: 0
0429 19:54:44.969412 (+ 420us) write_op.cc:270] Start()
0429 19:54:44.969448 (+ 36us) write_op.cc:276] Timestamp: P: 1777492474798248 usec, L: 0
0429 19:54:44.969701 (+ 253us) write_op.cc:270] Start()
0429 19:54:44.969733 (+ 32us) write_op.cc:276] Timestamp: P: 1777492474821747 usec, L: 0
0429 19:54:44.969904 (+ 171us) write_op.cc:270] Start()
0429 19:54:44.969926 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474832554 usec, L: 0
0429 19:54:44.970082 (+ 156us) write_op.cc:270] Start()
0429 19:54:44.970101 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474857404 usec, L: 0
0429 19:54:44.971793 (+ 1692us) write_op.cc:270] Start()
0429 19:54:44.971831 (+ 38us) write_op.cc:276] Timestamp: P: 1777492474866679 usec, L: 0
0429 19:54:44.997465 (+ 25634us) write_op.cc:270] Start()
0429 19:54:44.997510 (+ 45us) write_op.cc:276] Timestamp: P: 1777492474869449 usec, L: 0
0429 19:54:45.000806 (+ 3296us) write_op.cc:270] Start()
0429 19:54:45.000840 (+ 34us) write_op.cc:276] Timestamp: P: 1777492474882637 usec, L: 0
0429 19:54:45.001156 (+ 316us) write_op.cc:270] Start()
0429 19:54:45.001185 (+ 29us) write_op.cc:276] Timestamp: P: 1777492474922717 usec, L: 0
0429 19:54:45.002250 (+ 1065us) write_op.cc:270] Start()
0429 19:54:45.002275 (+ 25us) write_op.cc:276] Timestamp: P: 1777492474924309 usec, L: 0
0429 19:54:45.007090 (+ 4815us) write_op.cc:270] Start()
0429 19:54:45.007135 (+ 45us) write_op.cc:276] Timestamp: P: 1777492474947705 usec, L: 0
0429 19:54:45.012738 (+ 5603us) write_op.cc:270] Start()
0429 19:54:45.012766 (+ 28us) write_op.cc:276] Timestamp: P: 1777492474950717 usec, L: 0
0429 19:54:45.021158 (+ 8392us) write_op.cc:270] Start()
0429 19:54:45.021186 (+ 28us) write_op.cc:276] Timestamp: P: 1777492474979136 usec, L: 0
0429 19:54:45.025346 (+ 4160us) write_op.cc:270] Start()
0429 19:54:45.028451 (+ 3105us) write_op.cc:276] Timestamp: P: 1777492475006000 usec, L: 0
0429 19:54:45.032778 (+ 4327us) write_op.cc:270] Start()
0429 19:54:45.032812 (+ 34us) write_op.cc:276] Timestamp: P: 1777492475008360 usec, L: 0
0429 19:54:45.040891 (+ 8079us) write_op.cc:270] Start()
0429 19:54:45.040930 (+ 39us) write_op.cc:276] Timestamp: P: 1777492475011240 usec, L: 0
0429 19:54:45.046598 (+ 5668us) write_op.cc:270] Start()
0429 19:54:45.046622 (+ 24us) write_op.cc:276] Timestamp: P: 1777492475021962 usec, L: 0
0429 19:54:45.046800 (+ 178us) write_op.cc:270] Start()
0429 19:54:45.046920 (+ 120us) write_op.cc:276] Timestamp: P: 1777492475048704 usec, L: 0
0429 19:54:45.047119 (+ 199us) write_op.cc:270] Start()
0429 19:54:45.047143 (+ 24us) write_op.cc:276] Timestamp: P: 1777492475065749 usec, L: 0
0429 19:54:45.047342 (+ 199us) write_op.cc:270] Start()
0429 19:54:45.047366 (+ 24us) write_op.cc:276] Timestamp: P: 1777492475074246 usec, L: 0
0429 19:54:45.047507 (+ 141us) write_op.cc:270] Start()
0429 19:54:45.047528 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475085296 usec, L: 0
0429 19:54:45.047702 (+ 174us) write_op.cc:270] Start()
0429 19:54:45.047724 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475114016 usec, L: 0
0429 19:54:45.047883 (+ 159us) write_op.cc:270] Start()
0429 19:54:45.047904 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475114698 usec, L: 0
0429 19:54:45.048048 (+ 144us) write_op.cc:270] Start()
0429 19:54:45.048068 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475140703 usec, L: 0
0429 19:54:45.048218 (+ 150us) write_op.cc:270] Start()
0429 19:54:45.048236 (+ 18us) write_op.cc:276] Timestamp: P: 1777492475145974 usec, L: 0
0429 19:54:45.048404 (+ 168us) write_op.cc:270] Start()
0429 19:54:45.048421 (+ 17us) write_op.cc:276] Timestamp: P: 1777492475165930 usec, L: 0
0429 19:54:45.048540 (+ 119us) write_op.cc:270] Start()
0429 19:54:45.048555 (+ 15us) write_op.cc:276] Timestamp: P: 1777492475173922 usec, L: 0
0429 19:54:45.048677 (+ 122us) write_op.cc:270] Start()
0429 19:54:45.048693 (+ 16us) write_op.cc:276] Timestamp: P: 1777492475205149 usec, L: 0
0429 19:54:45.048820 (+ 127us) write_op.cc:270] Start()
0429 19:54:45.048840 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475216127 usec, L: 0
0429 19:54:45.048998 (+ 158us) write_op.cc:270] Start()
0429 19:54:45.049020 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475217025 usec, L: 0
0429 19:54:45.049169 (+ 149us) write_op.cc:270] Start()
0429 19:54:45.049195 (+ 26us) write_op.cc:276] Timestamp: P: 1777492475230461 usec, L: 0
0429 19:54:45.049336 (+ 141us) write_op.cc:270] Start()
0429 19:54:45.049353 (+ 17us) write_op.cc:276] Timestamp: P: 1777492475253713 usec, L: 0
0429 19:54:45.049479 (+ 126us) write_op.cc:270] Start()
0429 19:54:45.049495 (+ 16us) write_op.cc:276] Timestamp: P: 1777492475254427 usec, L: 0
0429 19:54:45.049610 (+ 115us) write_op.cc:270] Start()
0429 19:54:45.049627 (+ 17us) write_op.cc:276] Timestamp: P: 1777492475275365 usec, L: 0
0429 19:54:45.049743 (+ 116us) write_op.cc:270] Start()
0429 19:54:45.049758 (+ 15us) write_op.cc:276] Timestamp: P: 1777492475288442 usec, L: 0
0429 19:54:45.068173 (+ 18415us) write_op.cc:270] Start()
0429 19:54:45.068224 (+ 51us) write_op.cc:276] Timestamp: P: 1777492475306936 usec, L: 0
0429 19:54:45.070778 (+ 2554us) write_op.cc:270] Start()
0429 19:54:45.070820 (+ 42us) write_op.cc:276] Timestamp: P: 1777492475329245 usec, L: 0
0429 19:54:45.076481 (+ 5661us) write_op.cc:270] Start()
0429 19:54:45.076507 (+ 26us) write_op.cc:276] Timestamp: P: 1777492475331681 usec, L: 0
0429 19:54:45.081909 (+ 5402us) write_op.cc:270] Start()
0429 19:54:45.081952 (+ 43us) write_op.cc:276] Timestamp: P: 1777492475335932 usec, L: 0
0429 19:54:45.088652 (+ 6700us) write_op.cc:270] Start()
0429 19:54:45.088677 (+ 25us) write_op.cc:276] Timestamp: P: 1777492475371158 usec, L: 0
0429 19:54:45.092076 (+ 3399us) write_op.cc:270] Start()
0429 19:54:45.092104 (+ 28us) write_op.cc:276] Timestamp: P: 1777492475406382 usec, L: 0
0429 19:54:45.093643 (+ 1539us) write_op.cc:270] Start()
0429 19:54:45.093669 (+ 26us) write_op.cc:276] Timestamp: P: 1777492475407833 usec, L: 0
0429 19:54:45.095969 (+ 2300us) write_op.cc:270] Start()
0429 19:54:45.095996 (+ 27us) write_op.cc:276] Timestamp: P: 1777492475421906 usec, L: 0
0429 19:54:45.098822 (+ 2826us) write_op.cc:270] Start()
0429 19:54:45.098850 (+ 28us) write_op.cc:276] Timestamp: P: 1777492475441438 usec, L: 0
0429 19:54:45.099356 (+ 506us) write_op.cc:270] Start()
0429 19:54:45.099384 (+ 28us) write_op.cc:276] Timestamp: P: 1777492475464969 usec, L: 0
0429 19:54:45.114928 (+ 15544us) write_op.cc:270] Start()
0429 19:54:45.114963 (+ 35us) write_op.cc:276] Timestamp: P: 1777492475502437 usec, L: 0
0429 19:54:45.115176 (+ 213us) write_op.cc:270] Start()
0429 19:54:45.115201 (+ 25us) write_op.cc:276] Timestamp: P: 1777492475504254 usec, L: 0
0429 19:54:45.115443 (+ 242us) write_op.cc:270] Start()
0429 19:54:45.115467 (+ 24us) write_op.cc:276] Timestamp: P: 1777492475517306 usec, L: 0
0429 19:54:45.115620 (+ 153us) write_op.cc:270] Start()
0429 19:54:45.115642 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475518239 usec, L: 0
0429 19:54:45.123637 (+ 7995us) write_op.cc:270] Start()
0429 19:54:45.149037 (+ 25400us) write_op.cc:276] Timestamp: P: 1777492475540704 usec, L: 0
0429 19:54:45.149308 (+ 271us) write_op.cc:270] Start()
0429 19:54:45.149333 (+ 25us) write_op.cc:276] Timestamp: P: 1777492475586203 usec, L: 0
0429 19:54:45.149495 (+ 162us) write_op.cc:270] Start()
0429 19:54:45.149513 (+ 18us) write_op.cc:276] Timestamp: P: 1777492475586817 usec, L: 0
0429 19:54:45.151643 (+ 2130us) write_op.cc:270] Start()
0429 19:54:45.151669 (+ 26us) write_op.cc:276] Timestamp: P: 1777492475588001 usec, L: 0
0429 19:54:45.152133 (+ 464us) write_op.cc:270] Start()
0429 19:54:45.152159 (+ 26us) write_op.cc:276] Timestamp: P: 1777492475592615 usec, L: 0
0429 19:54:45.152330 (+ 171us) write_op.cc:270] Start()
0429 19:54:45.152353 (+ 23us) write_op.cc:276] Timestamp: P: 1777492475634076 usec, L: 0
0429 19:54:45.153058 (+ 705us) write_op.cc:270] Start()
0429 19:54:45.153097 (+ 39us) write_op.cc:276] Timestamp: P: 1777492475652103 usec, L: 0
0429 19:54:45.153269 (+ 172us) write_op.cc:270] Start()
0429 19:54:45.153290 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475656880 usec, L: 0
0429 19:54:45.153435 (+ 145us) write_op.cc:270] Start()
0429 19:54:45.153456 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475661719 usec, L: 0
0429 19:54:45.153605 (+ 149us) write_op.cc:270] Start()
0429 19:54:45.153625 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475705861 usec, L: 0
0429 19:54:45.153792 (+ 167us) write_op.cc:270] Start()
0429 19:54:45.153812 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475710900 usec, L: 0
0429 19:54:45.153948 (+ 136us) write_op.cc:270] Start()
0429 19:54:45.153966 (+ 18us) write_op.cc:276] Timestamp: P: 1777492475748327 usec, L: 0
0429 19:54:45.167096 (+ 13130us) write_op.cc:270] Start()
0429 19:54:45.167134 (+ 38us) write_op.cc:276] Timestamp: P: 1777492475762341 usec, L: 0
0429 19:54:45.167749 (+ 615us) write_op.cc:270] Start()
0429 19:54:45.167771 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475763118 usec, L: 0
0429 19:54:45.167929 (+ 158us) write_op.cc:270] Start()
0429 19:54:45.167949 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475778951 usec, L: 0
0429 19:54:45.168141 (+ 192us) write_op.cc:270] Start()
0429 19:54:45.168163 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475803227 usec, L: 0
0429 19:54:45.168346 (+ 183us) write_op.cc:270] Start()
0429 19:54:45.168367 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475806610 usec, L: 0
0429 19:54:45.168527 (+ 160us) write_op.cc:270] Start()
0429 19:54:45.168563 (+ 36us) write_op.cc:276] Timestamp: P: 1777492475846871 usec, L: 0
0429 19:54:45.168720 (+ 157us) write_op.cc:270] Start()
0429 19:54:45.168741 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475856968 usec, L: 0
0429 19:54:45.169295 (+ 554us) write_op.cc:270] Start()
0429 19:54:45.169321 (+ 26us) write_op.cc:276] Timestamp: P: 1777492475870101 usec, L: 0
0429 19:54:45.169512 (+ 191us) write_op.cc:270] Start()
0429 19:54:45.169532 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475872689 usec, L: 0
0429 19:54:45.169696 (+ 164us) write_op.cc:270] Start()
0429 19:54:45.169717 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475923316 usec, L: 0
0429 19:54:45.169855 (+ 138us) write_op.cc:270] Start()
0429 19:54:45.169876 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475953314 usec, L: 0
0429 19:54:45.172882 (+ 3006us) write_op.cc:270] Start()
0429 19:54:45.172905 (+ 23us) write_op.cc:276] Timestamp: P: 1777492475958857 usec, L: 0
0429 19:54:45.174366 (+ 1461us) write_op.cc:270] Start()
0429 19:54:45.174432 (+ 66us) write_op.cc:276] Timestamp: P: 1777492475963595 usec, L: 0
0429 19:54:45.178010 (+ 3578us) write_op.cc:270] Start()
0429 19:54:45.178034 (+ 24us) write_op.cc:276] Timestamp: P: 1777492475964202 usec, L: 0
0429 19:54:45.182573 (+ 4539us) write_op.cc:270] Start()
0429 19:54:45.182602 (+ 29us) write_op.cc:276] Timestamp: P: 1777492476000893 usec, L: 0
0429 19:54:45.182778 (+ 176us) write_op.cc:270] Start()
0429 19:54:45.182800 (+ 22us) write_op.cc:276] Timestamp: P: 1777492476030534 usec, L: 0
0429 19:54:45.190659 (+ 7859us) write_op.cc:270] Start()
0429 19:54:45.195387 (+ 4728us) write_op.cc:276] Timestamp: P: 1777492476033169 usec, L: 0
0429 19:54:45.196712 (+ 1325us) write_op.cc:270] Start()
0429 19:54:45.196739 (+ 27us) write_op.cc:276] Timestamp: P: 1777492476033719 usec, L: 0
0429 19:54:45.199951 (+ 3212us) write_op.cc:270] Start()
0429 19:54:45.199977 (+ 26us) write_op.cc:276] Timestamp: P: 177749
I20260429 19:54:49.344195 11412 raft_consensus.cc:493] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:54:49.345186 11412 raft_consensus.cc:515] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:49.346071 11412 leader_election.cc:290] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:49.347873 10806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3449d2f7451d4a758233c5a1372a2960" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 149 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:49.347875 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3449d2f7451d4a758233c5a1372a2960" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 149 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:49.349107 11276 leader_election.cc:304] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:49.349717 11412 raft_consensus.cc:2749] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 19:54:49.354653 11412 raft_consensus.cc:493] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:49.356459 11412 raft_consensus.cc:515] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:49.364933 11412 leader_election.cc:290] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:49.371209 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 762 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:49.372428 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 762 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:49.373061 11276 leader_election.cc:304] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:49.392248 11412 raft_consensus.cc:2749] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 19:54:49.926355 11349 raft_consensus.cc:1217] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.148->[1.149-1.986] Dedup: 1.149->[1.150-1.986]
I20260429 19:54:49.976912 11412 raft_consensus.cc:493] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:50.003577 11412 raft_consensus.cc:515] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:50.004516 11412 leader_election.cc:290] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:50.004913 10810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b920d515ed1846c2a4b44b05f05f9886" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 989 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:50.005115 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b920d515ed1846c2a4b44b05f05f9886" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 989 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:50.014747 11276 leader_election.cc:304] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:50.032475 11448 raft_consensus.cc:2749] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260429 19:54:50.403578 11447 raft_consensus.cc:493] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:50.432898 11447 raft_consensus.cc:515] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:50.462459 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b920d515ed1846c2a4b44b05f05f9886" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1030 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:50.462459 10809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b920d515ed1846c2a4b44b05f05f9886" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1030 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:50.469660 11447 leader_election.cc:290] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:50.470156 11276 leader_election.cc:304] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:50.506062 11447 raft_consensus.cc:2749] T b920d515ed1846c2a4b44b05f05f9886 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260429 19:54:50.510710 11445 raft_consensus.cc:493] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b091bf2bbc547978432dfe2dbc1ffcd)
I20260429 19:54:50.510943 11445 raft_consensus.cc:515] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:50.552671 11350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.32.67:35721 (request call id 15) took 1247 ms. Trace:
I20260429 19:54:50.565304 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 996 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:50.565928 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 996 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:50.567696 11445 leader_election.cc:290] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:50.571851 11276 leader_election.cc:304] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:50.572367 11445 raft_consensus.cc:2749] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260429 19:54:50.787922 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 116: this message will repeat every 5th retry.
I20260429 19:54:50.946450 11445 raft_consensus.cc:493] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b091bf2bbc547978432dfe2dbc1ffcd)
I20260429 19:54:50.946671 11445 raft_consensus.cc:515] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:50.949901 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 996 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:50.951256 10810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 996 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:50.952010 11276 leader_election.cc:304] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:50.966615 11447 raft_consensus.cc:2749] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260429 19:54:50.966948 11445 leader_election.cc:290] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:51.026750 11446 raft_consensus.cc:493] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:51.026970 11446 raft_consensus.cc:515] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:51.046725 11353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.32.66:59965 (request call id 22) took 1754 ms. Trace:
I20260429 19:54:51.053341 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1000 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:51.053469 10810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1000 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:51.055716 11348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.32.66:59965 (request call id 23) took 1708 ms. Trace:
I20260429 19:54:51.098807 11412 raft_consensus.cc:493] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:51.099002 11412 raft_consensus.cc:515] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:51.108314 11276 leader_election.cc:304] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:51.108675 11445 raft_consensus.cc:2749] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260429 19:54:51.108615 11276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.32.66:41183, user_credentials={real_user=slave}} blocked reactor thread for 53694.6us
I20260429 19:54:51.109340 11412 leader_election.cc:290] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:51.110981 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1002 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:51.111853 11446 leader_election.cc:290] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:51.115649 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1002 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:51.126634 11276 leader_election.cc:304] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:51.126958 11446 raft_consensus.cc:2749] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260429 19:54:50.563185 11350 rpcz_store.cc:276] 0429 19:54:49.260878 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 19:54:49.260929 (+ 51us) service_pool.cc:225] Handling call
0429 19:54:49.303996 (+ 43067us) raft_consensus.cc:1471] Updating replica for 242 ops
0429 19:54:49.528764 (+224768us) raft_consensus.cc:1534] Early marking committed up to index 0
0429 19:54:49.528769 (+ 5us) raft_consensus.cc:1539] Triggering prepare for 242 ops
0429 19:54:49.528924 (+ 155us) write_op.cc:270] Start()
0429 19:54:49.528966 (+ 42us) write_op.cc:276] Timestamp: P: 1777492484117701 usec, L: 0
0429 19:54:49.529169 (+ 203us) write_op.cc:270] Start()
0429 19:54:49.529187 (+ 18us) write_op.cc:276] Timestamp: P: 1777492484118973 usec, L: 0
0429 19:54:49.529345 (+ 158us) write_op.cc:270] Start()
0429 19:54:49.529362 (+ 17us) write_op.cc:276] Timestamp: P: 1777492484120325 usec, L: 0
0429 19:54:49.529516 (+ 154us) write_op.cc:270] Start()
0429 19:54:49.529533 (+ 17us) write_op.cc:276] Timestamp: P: 1777492484175227 usec, L: 0
0429 19:54:49.529670 (+ 137us) write_op.cc:270] Start()
0429 19:54:49.529700 (+ 30us) write_op.cc:276] Timestamp: P: 1777492484216988 usec, L: 0
0429 19:54:49.529848 (+ 148us) write_op.cc:270] Start()
0429 19:54:49.529866 (+ 18us) write_op.cc:276] Timestamp: P: 1777492484239763 usec, L: 0
0429 19:54:49.529993 (+ 127us) write_op.cc:270] Start()
0429 19:54:49.530037 (+ 44us) write_op.cc:276] Timestamp: P: 1777492484266916 usec, L: 0
0429 19:54:49.530153 (+ 116us) write_op.cc:270] Start()
0429 19:54:49.530168 (+ 15us) write_op.cc:276] Timestamp: P: 1777492484280225 usec, L: 0
0429 19:54:49.530326 (+ 158us) write_op.cc:270] Start()
0429 19:54:49.530343 (+ 17us) write_op.cc:276] Timestamp: P: 1777492484313502 usec, L: 0
0429 19:54:49.546617 (+ 16274us) write_op.cc:270] Start()
0429 19:54:49.546646 (+ 29us) write_op.cc:276] Timestamp: P: 1777492484383907 usec, L: 0
0429 19:54:49.649304 (+102658us) write_op.cc:270] Start()
0429 19:54:49.649329 (+ 25us) write_op.cc:276] Timestamp: P: 1777492484389785 usec, L: 0
0429 19:54:49.652601 (+ 3272us) write_op.cc:270] Start()
0429 19:54:49.652628 (+ 27us) write_op.cc:276] Timestamp: P: 1777492484390291 usec, L: 0
0429 19:54:49.660916 (+ 8288us) write_op.cc:270] Start()
0429 19:54:49.660969 (+ 53us) write_op.cc:276] Timestamp: P: 1777492484426198 usec, L: 0
0429 19:54:49.661193 (+ 224us) write_op.cc:270] Start()
0429 19:54:49.661214 (+ 21us) write_op.cc:276] Timestamp: P: 1777492484446984 usec, L: 0
0429 19:54:49.665141 (+ 3927us) write_op.cc:270] Start()
0429 19:54:49.667117 (+ 1976us) write_op.cc:276] Timestamp: P: 1777492484505619 usec, L: 0
0429 19:54:49.667757 (+ 640us) write_op.cc:270] Start()
0429 19:54:49.667789 (+ 32us) write_op.cc:276] Timestamp: P: 1777492484510521 usec, L: 0
0429 19:54:49.674600 (+ 6811us) write_op.cc:270] Start()
0429 19:54:49.674630 (+ 30us) write_op.cc:276] Timestamp: P: 1777492484511167 usec, L: 0
0429 19:54:49.674836 (+ 206us) write_op.cc:270] Start()
0429 19:54:49.674859 (+ 23us) write_op.cc:276] Timestamp: P: 1777492484511695 usec, L: 0
0429 19:54:49.675021 (+ 162us) write_op.cc:270] Start()
0429 19:54:49.675041 (+ 20us) write_op.cc:276] Timestamp: P: 1777492484543046 usec, L: 0
0429 19:54:49.678715 (+ 3674us) write_op.cc:270] Start()
0429 19:54:49.678746 (+ 31us) write_op.cc:276] Timestamp: P: 1777492484550285 usec, L: 0
0429 19:54:49.679794 (+ 1048us) write_op.cc:270] Start()
0429 19:54:49.679819 (+ 25us) write_op.cc:276] Timestamp: P: 1777492484563772 usec, L: 0
0429 19:54:49.679994 (+ 175us) write_op.cc:270] Start()
0429 19:54:49.680011 (+ 17us) write_op.cc:276] Timestamp: P: 1777492484568254 usec, L: 0
0429 19:54:49.680144 (+ 133us) write_op.cc:270] Start()
0429 19:54:49.680160 (+ 16us) write_op.cc:276] Timestamp: P: 1777492484605785 usec, L: 0
0429 19:54:49.680283 (+ 123us) write_op.cc:270] Start()
0429 19:54:49.680299 (+ 16us) write_op.cc:276] Timestamp: P: 1777492484621738 usec, L: 0
0429 19:54:49.680476 (+ 177us) write_op.cc:270] Start()
0429 19:54:49.680493 (+ 17us) write_op.cc:276] Timestamp: P: 1777492484631129 usec, L: 0
0429 19:54:49.680619 (+ 126us) write_op.cc:270] Start()
0429 19:54:49.680635 (+ 16us) write_op.cc:276] Timestamp: P: 1777492484644079 usec, L: 0
0429 19:54:49.680737 (+ 102us) write_op.cc:270] Start()
0429 19:54:49.680751 (+ 14us) write_op.cc:276] Timestamp: P: 1777492484661697 usec, L: 0
0429 19:54:49.680850 (+ 99us) write_op.cc:270] Start()
0429 19:54:49.680865 (+ 15us) write_op.cc:276] Timestamp: P: 1777492484703071 usec, L: 0
0429 19:54:49.700622 (+ 19757us) write_op.cc:270] Start()
0429 19:54:49.700648 (+ 26us) write_op.cc:276] Timestamp: P: 1777492484707452 usec, L: 0
0429 19:54:49.703175 (+ 2527us) write_op.cc:270] Start()
0429 19:54:49.703200 (+ 25us) write_op.cc:276] Timestamp: P: 1777492484745606 usec, L: 0
0429 19:54:49.703383 (+ 183us) write_op.cc:270] Start()
0429 19:54:49.703403 (+ 20us) write_op.cc:276] Timestamp: P: 1777492484761922 usec, L: 0
0429 19:54:49.703604 (+ 201us) write_op.cc:270] Start()
0429 19:54:49.703626 (+ 22us) write_op.cc:276] Timestamp: P: 1777492484782509 usec, L: 0
0429 19:54:49.703821 (+ 195us) write_op.cc:270] Start()
0429 19:54:49.703844 (+ 23us) write_op.cc:276] Timestamp: P: 1777492484809067 usec, L: 0
0429 19:54:49.704017 (+ 173us) write_op.cc:270] Start()
0429 19:54:49.704040 (+ 23us) write_op.cc:276] Timestamp: P: 1777492484839326 usec, L: 0
0429 19:54:49.704194 (+ 154us) write_op.cc:270] Start()
0429 19:54:49.704216 (+ 22us) write_op.cc:276] Timestamp: P: 1777492484848742 usec, L: 0
0429 19:54:49.704369 (+ 153us) write_op.cc:270] Start()
0429 19:54:49.704390 (+ 21us) write_op.cc:276] Timestamp: P: 1777492484887800 usec, L: 0
0429 19:54:49.704560 (+ 170us) write_op.cc:270] Start()
0429 19:54:49.704583 (+ 23us) write_op.cc:276] Timestamp: P: 1777492484924804 usec, L: 0
0429 19:54:49.704732 (+ 149us) write_op.cc:270] Start()
0429 19:54:49.704752 (+ 20us) write_op.cc:276] Timestamp: P: 1777492484944066 usec, L: 0
0429 19:54:49.704908 (+ 156us) write_op.cc:270] Start()
0429 19:54:49.704929 (+ 21us) write_op.cc:276] Timestamp: P: 1777492484961522 usec, L: 0
0429 19:54:49.705102 (+ 173us) write_op.cc:270] Start()
0429 19:54:49.705124 (+ 22us) write_op.cc:276] Timestamp: P: 1777492484969887 usec, L: 0
0429 19:54:49.705334 (+ 210us) write_op.cc:270] Start()
0429 19:54:49.705356 (+ 22us) write_op.cc:276] Timestamp: P: 1777492484983269 usec, L: 0
0429 19:54:49.705661 (+ 305us) write_op.cc:270] Start()
0429 19:54:49.705687 (+ 26us) write_op.cc:276] Timestamp: P: 1777492485042164 usec, L: 0
0429 19:54:49.705870 (+ 183us) write_op.cc:270] Start()
0429 19:54:49.705894 (+ 24us) write_op.cc:276] Timestamp: P: 1777492485043678 usec, L: 0
0429 19:54:49.706139 (+ 245us) write_op.cc:270] Start()
0429 19:54:49.706163 (+ 24us) write_op.cc:276] Timestamp: P: 1777492485072570 usec, L: 0
0429 19:54:49.706324 (+ 161us) write_op.cc:270] Start()
0429 19:54:49.706345 (+ 21us) write_op.cc:276] Timestamp: P: 1777492485073235 usec, L: 0
0429 19:54:49.706538 (+ 193us) write_op.cc:270] Start()
0429 19:54:49.706560 (+ 22us) write_op.cc:276] Timestamp: P: 1777492485096282 usec, L: 0
0429 19:54:49.706731 (+ 171us) write_op.cc:270] Start()
0429 19:54:49.706752 (+ 21us) write_op.cc:276] Timestamp: P: 1777492485100909 usec, L: 0
0429 19:54:49.706887 (+ 135us) write_op.cc:270] Start()
0429 19:54:49.706904 (+ 17us) write_op.cc:276] Timestamp: P: 1777492485135035 usec, L: 0
0429 19:54:49.707050 (+ 146us) write_op.cc:270] Start()
0429 19:54:49.707070 (+ 20us) write_op.cc:276] Timestamp: P: 1777492485137238 usec, L: 0
0429 19:54:49.707217 (+ 147us) write_op.cc:270] Start()
0429 19:54:49.707237 (+ 20us) write_op.cc:276] Timestamp: P: 1777492485147543 usec, L: 0
0429 19:54:49.707395 (+ 158us) write_op.cc:270] Start()
0429 19:54:49.707415 (+ 20us) write_op.cc:276] Timestamp: P: 1777492485159079 usec, L: 0
0429 19:54:49.707579 (+ 164us) write_op.cc:270] Start()
0429 19:54:49.707601 (+ 22us) write_op.cc:276] Timestamp: P: 1777492485187189 usec, L: 0
0429 19:54:49.707765 (+ 164us) write_op.cc:270] Start()
0429 19:54:49.707787 (+ 22us) write_op.cc:276] Timestamp: P: 1777492485197203 usec, L: 0
0429 19:54:49.707959 (+ 172us) write_op.cc:270] Start()
0429 19:54:49.707982 (+ 23us) write_op.cc:276] Timestamp: P: 1777492485201625 usec, L: 0
0429 19:54:49.708157 (+ 175us) write_op.cc:270] Start()
0429 19:54:49.708178 (+ 21us) write_op.cc:276] Timestamp: P: 1777492485228764 usec, L: 0
0429 19:54:49.708342 (+ 164us) write_op.cc:270] Start()
0429 19:54:49.708363 (+ 21us) write_op.cc:276] Timestamp: P: 1777492485265740 usec, L: 0
0429 19:54:49.708533 (+ 170us) write_op.cc:270] Start()
0429 19:54:49.708556 (+ 23us) write_op.cc:276] Timestamp: P: 1777492485268010 usec, L: 0
0429 19:54:49.708721 (+ 165us) write_op.cc:270] Start()
0429 19:54:49.708743 (+ 22us) write_op.cc:276] Timestamp: P: 1777492485278358 usec, L: 0
0429 19:54:49.708896 (+ 153us) write_op.cc:270] Start()
0429 19:54:49.708916 (+ 20us) write_op.cc:276] Timestamp: P: 1777492485282447 usec, L: 0
0429 19:54:49.709072 (+ 156us) write_op.cc:270] Start()
0429 19:54:49.709110 (+ 38us) write_op.cc:276] Timestamp: P: 1777492485339727 usec, L: 0
0429 19:54:49.709278 (+ 168us) write_op.cc:270] Start()
0429 19:54:49.709304 (+ 26us) write_op.cc:276] Timestamp: P: 1777492485358839 usec, L: 0
0429 19:54:49.709485 (+ 181us) write_op.cc:270] Start()
0429 19:54:49.709518 (+ 33us) write_op.cc:276] Timestamp: P: 1777492485368783 usec, L: 0
0429 19:54:49.709712 (+ 194us) write_op.cc:270] Start()
0429 19:54:49.709736 (+ 24us) write_op.cc:276] Timestamp: P: 1777492485375995 usec, L: 0
0429 19:54:49.709881 (+ 145us) write_op.cc:270] Start()
0429 19:54:49.709910 (+ 29us) write_op.cc:276] Timestamp: P: 1777492485415543 usec, L: 0
0429 19:54:49.710091 (+ 181us) write_op.cc:270] Start()
0429 19:54:49.710112 (+ 21us) write_op.cc:276] Timestamp: P: 1777492485464437 usec, L: 0
0429 19:54:49.710261 (+ 149us) write_op.cc:270] Start()
0429 19:54:49.710280 (+ 19us) write_op.cc:276] Timestamp: P: 1777492485469529 usec, L: 0
0429 19:54:49.710439 (+ 159us) write_op.cc:270] Start()
0429 19:54:49.710459 (+ 20us) write_op.cc:276] Timestamp: P: 1777492485473234 usec, L: 0
0429 19:54:49.710636 (+ 177us) write_op.cc:270] Start()
0429 19:54:49.710657 (+ 21us) write_op.cc:276] Timestamp: P: 1777492485487574 usec, L: 0
0429 19:54:49.710824 (+ 167us) write_op.cc:270] Start()
0429 19:54:49.710844 (+ 20us) write_op.cc:276] Timestamp: P: 1777492485522678 usec, L: 0
0429 19:54:49.710986 (+ 142us) write_op.cc:270] Start()
0429 19:54:49.711009 (+ 23us) write_op.cc:276] Timestamp: P: 1777492485567194 usec, L: 0
0429 19:54:49.711140 (+ 131us) write_op.cc:270] Start()
0429 19:54:49.711159 (+ 19us) write_op.cc:276] Timestamp: P: 1777492485570313 usec, L: 0
0429 19:54:49.711307 (+ 148us) write_op.cc:270] Start()
0429 19:54:49.711325 (+ 18us) write_op.cc:276] Timestamp: P: 1777492485632082 usec, L: 0
0429 19:54:49.711493 (+ 168us) write_op.cc:270] Start()
0429 19:54:49.711521 (+ 28us) write_op.cc:276] Timestamp: P: 1777492485668665 usec, L: 0
0429 19:54:49.711683 (+ 162us) write_op.cc:270] Start()
0429 19:54:49.711705 (+ 22us) write_op.cc:276] Timestamp: P: 1777492485676111 usec, L: 0
0429 19:54:49.711837 (+ 132us) write_op.cc:270] Start()
0429 19:54:49.711860 (+ 23us) write_op.cc:276] Timestamp: P: 1777492485676706 usec, L: 0
0429 19:54:49.711994 (+ 134us) write_op.cc:270] Start()
0429 19:54:49.712012 (+ 18us) write_op.cc:276] Timestamp: P: 1777492485682905 usec, L: 0
0429 19:54:49.712147 (+ 135us) write_op.cc:270] Start()
0429 19:54:49.712166 (+ 19us) write_op.cc:276] Timestamp: P: 1777492485738731 usec, L: 0
0429 19:54:49.712303 (+ 137us) write_op.cc:270] Start()
0429 19:54:49.712321 (+ 18us) write_op.cc:276] Timestamp: P: 1777492485765615 usec, L: 0
0429 19:54:49.712482 (+ 161us) write_op.cc:270] Start()
0429 19:54:49.712510 (+ 28us) write_op.cc:276] Timestamp: P: 1777492485766403 usec, L: 0
0429 19:54:49.712706 (+ 196us) write_op.cc:270] Start()
0429 19:54:49.712726 (+ 20us) write_op.cc:276] Timestamp: P: 1777492485778459 usec, L: 0
0429 19:54:49.712891 (+ 165us) write_op.cc:270] Start()
0429 19:54:49.712910 (+ 19us) write_op.cc:276] Timestamp: P: 1777492485806267 usec, L: 0
0429 19:54:49.713042 (+ 132us) write_op.cc:270] Start()
0429 19:54:49.713065 (+ 23us) write_op.cc:276] Timestamp: P: 1777492485823171 usec, L: 0
0429 19:54:49.713263 (+ 198us) write_op.cc:270] Start()
0429 19:54:49.713283 (+ 20us) write_op.cc:276] Timestamp: P: 1777492485855631 usec, L: 0
0429 19:54:49.713420 (+ 137us) write_op.cc:270] Start()
0429 19:54:49.713444 (+ 24us) write_op.cc:276] Timestamp: P: 1777492485860883 usec, L: 0
0429 19:54:49.713611 (+ 167us) write_op.cc:270] Start()
0429 19:54:49.713630 (+ 19us) write_op.cc:276] Timestamp: P: 1777492485880532 usec, L: 0
0429 19:54:49.713777 (+ 147us) write_op.cc:270] Start()
0429 19:54:49.713797 (+ 20us) write_op.cc:276] Timestamp: P: 1777492485881204 usec, L: 0
0429 19:54:49.713935 (+ 138us) write_op.cc:270] Start()
0429 19:54:49.713953 (+ 18us) write_op.cc:276] Timestamp: P: 1777492485940721 usec, L: 0
0429 19:54:49.714099 (+ 146us) write_op.cc:270] Start()
0429 19:54:49.714118 (+ 19us) write_op.cc:276] Timestamp: P: 1777492485944586 usec, L: 0
0429 19:54:49.714247 (+ 129us) write_op.cc:270] Start()
0429 19:54:49.714265 (+ 18us) write_op.cc:276] Timestamp: P: 1777492485946850 usec, L: 0
0429 19:54:49.728511 (+ 14246us) write_op.cc:270] Start()
0429 19:54:49.728543 (+ 32us) write_op.cc:276] Timestamp: P: 1777492485972906 usec, L: 0
0429 19:54:49.740685 (+ 12142us) write_op.cc:270] Start()
0429 19:54:49.740709 (+ 24us) write_op.cc:276] Timestamp: P: 1777492485992872 usec, L: 0
0429 19:54:49.740871 (+ 162us) write_op.cc:270] Start()
0429 19:54:49.740889 (+ 18us) write_op.cc:276] Timestamp: P: 1777492486024424 usec, L: 0
0429 19:54:49.744248 (+ 3359us) write_op.cc:270] Start()
0429 19:54:49.744271 (+ 23us) write_op.cc:276] Timestamp: P: 1777492486037311 usec, L: 0
0429 19:54:49.754883 (+ 10612us) write_op.cc:270] Start()
0429 19:54:49.754915 (+ 32us) write_op.cc:276] Timestamp: P: 1777492486052758 usec, L: 0
0429 19:54:49.766707 (+ 11792us) write_op.cc:270] Start()
0429 19:54:49.766745 (+ 38us) write_op.cc:276] Timestamp: P: 1777492486059506 usec, L: 0
0429 19:54:49.775540 (+ 8795us) write_op.cc:270] Start()
0429 19:54:49.775570 (+ 30us) write_op.cc:276] Timestamp: P: 1777492486113880 usec, L: 0
0429 19:54:49.775727 (+ 157us) write_op.cc:270] Start()
0429 19:54:49.775745 (+ 18us) write_op.cc:276] Timestamp: P: 1777492486119457 usec, L: 0
0429 19:54:49.778319 (+ 2574us) write_op.cc:270] Start()
0429 19:54:49.778341 (+ 22us) write_op.cc:276] Timestamp: P: 1777492486126478 usec, L: 0
0429 19:54:49.783031 (+ 4690us) write_op.cc:270] Start()
0429 19:54:49.783061 (+ 30us) write_op.cc:276] Timestamp: P: 1777492486133565 usec, L: 0
0429 19:54:49.783236 (+ 175us) write_op.cc:270] Start()
0429 19:54:49.783769 (+ 533us) write_op.cc:276] Timestamp: P: 1777492486212648 usec, L: 0
0429 19:54:49.783943 (+ 174us) write_op.cc:270] Start()
0429 19:54:49.783967 (+ 24us) write_op.cc:276] Timestamp: P: 1777492486264104 usec, L: 0
0429 19:54:49.784130 (+ 163us) write_op.cc:270] Start()
0429 19:54:49.784151 (+ 21us) write_op.cc:276] Timestamp: P: 1777492486265337 usec, L: 0
0429 19:54:49.784289 (+ 138us) write_op.cc:270] Start()
0429 19:54:49.784308 (+ 19us) write_op.cc:276] Timestamp: P: 1777492486283230 usec, L: 0
0429 19:54:49.820825 (+ 36517us) write_op.cc:270] Start()
0429 19:54:49.820845 (+ 20us) write_op.cc:276] Timestamp: P: 1777492486285381 usec, L: 0
0429 19:54:49.820996 (+ 151us) write_op.cc:270] Start()
0429 19:54:49.821014 (+ 18us) write_op.cc:276] Timestamp: P: 1777492486343183 usec, L: 0
0429 19:54:49.840283 (+ 19269us) write_op.cc:270] Start()
0429 19:54:49.840316 (+ 33us) write_op.cc:276] Timestamp: P: 1777492486364355 usec, L: 0
0429 19:54:49.840555 (+ 239us) write_op.cc:270] Start()
0429 19:54:49.840578 (+ 23us) write_op.cc:276] Timestamp: P: 1777492486401697 usec, L: 0
0429 19:54:49.840756 (+ 178us) write_op.cc:270] Start()
0429 19:54:49.840777 (+ 21us) write_op.cc:276] Timestamp: P: 1777492486404162 usec, L: 0
0429 19:54:49.840938 (+ 161us) write_op.cc:270] Start()
0429 19:54:49.840958 (+ 20us) write_op.cc:276] Timestamp: P: 1777492486426978 usec, L: 0
0429 19:54:49.841106 (+ 148us) write_op.cc:270] Start()
0429 19:54:49.841126 (+ 20us) write_op.cc:276] Timestamp: P: 1777492486483916 usec, L: 0
0429 19:54:49.841276 (+ 150us) write_op.cc:270] Start()
0429 19:54:49.841296 (+ 20us) write_op.cc:276] Timestamp: P: 1777492486500248 usec, L: 0
0429 19:54:49.841438 (+ 142us) write_op.cc:270] Start()
0429 19:54:49.841459 (+ 21us) write_op.cc:276] Timestamp: P: 1777492486514127 usec, L: 0
0429 19:54:49.841625 (+ 166us) write_op.cc:270] Start()
0429 19:54:49.841647 (+ 22us) write_op.cc:276] Timestamp: P: 1777492486514775 usec, L: 0
0429 19:54:49.841798 (+ 151us) write_op.cc:270] Start()
0429 19:54:49.841819 (+ 21us) write_op.cc:276] Timestamp: P: 1777492486630283 usec, L: 0
0429 19:54:49.841979 (+ 160us) write_op.cc:270] Start()
0429 19:54:49.842001 (+ 22us) write_op.cc:276] Timestamp: P: 1777492486652532 usec, L: 0
0429 19:54:49.842154 (+ 153us) write_op.cc:270] Start()
0429 19:54:49.842174 (+ 20us) write_op.cc:276] Timestamp: P: 1777492486655989 usec, L: 0
0429 19:54:49.842354 (+ 180us) write_op.cc:270] Start()
0429 19:54:49.842371 (+ 17us) write_op.cc:276] Timestamp: P: 1777492486659814 usec, L: 0
0429 19:54:49.842537 (+ 166us) write_op.cc:270] Start()
0429 19:54:49.842556 (+ 19us) write_op.cc:276] Timestamp: P: 1777492486722257 usec, L: 0
0429 19:54:49.842724 (+ 168us) write_op.cc:270] Start()
0429 19:54:49.842747 (+ 23us) write_op.cc:276] Timestamp: P: 1777492486738586 usec, L: 0
0429 19:54:49.847179 (+ 4432us) write_op.cc:270] Start()
0429 19:54:49.847227 (+ 48us) write_op.cc:276] Timestamp: P: 1777492486740570 usec, L: 0
0429 19:54:49.848574 (+ 1347us) write_op.cc:270] Start()
0429 19:54:49.848593 (+ 19us) write_op.cc:276] Timestamp: P: 1777492486741385 usec, L: 0
0429 19:54:49.859962 (+ 11369us) write_op.cc:270] Start()
0429 19:54:49.859990 (+ 28us) write_op.cc:276] Timestamp: P: 1777492486790249 usec, L: 0
0429 19:54:49.861011 (+ 1021us) write_op.cc:270] Start()
0429 19:54:49.861042 (+ 31us) write_op.cc:276] Timestamp: P: 1777492486806540 usec, L: 0
0429 19:54:49.861230 (+ 188us) write_op.cc:270] Start()
0429 19:54:49.861264 (+ 34us) write_op.cc:276] Timestamp: P: 1777492486807121 usec, L: 0
0429 19:54:49.861394 (+ 130us) write_op.cc:270] Start()
0429 19:54:49.861411 (+ 17us) write_op.cc:276] Timestamp: P: 1777492486808163 usec, L: 0
0429 19:54:49.870664 (+ 9253us) write_op.cc:270] Start()
0429 19:54:49.870691 (+ 27us) write_op.cc:276] Timestamp: P: 1777492486859704 usec, L: 0
0429 19:54:49.871277 (+ 586us) write_op.cc:270] Start()
0429 19:54:49.871302 (+ 25us) write_op.cc:276] Timestamp: P: 1777492486860814 usec, L: 0
0429 19:54:49.873455 (+ 2153us) write_op.cc:270] Start()
0429 19:54:49.873479 (+ 24us) write_op.cc:276] Timestamp: P: 1777492486864761 usec, L: 0
0429 19:54:49.876286 (+ 2807us) write_op.cc:270] Start()
0429 19:54:49.876316 (+ 30us) write_op.cc:276] Timestamp: P: 1777492486878950 usec, L: 0
0429 19:54:49.876496 (+ 180us) write_op.cc:270] Start()
0429 19:54:49.876520 (+ 24us) write_op.cc:276] Timestamp: P: 1777492486929845 usec, L: 0
0429 19:54:49.879252 (+ 2732us) write_op.cc:270] Start()
0429 19:54:49.879299 (+ 47us) write_op.cc:276] Timestamp: P: 1777492486965249 usec, L: 0
0429 19:54:49.879461 (+ 162us) write_op.cc:270] Start()
0429 19:54:49.879479 (+ 18us) write_op.cc:276] Timestamp: P: 1777492486992579 usec, L: 0
0429 19:54:49.879621 (+ 142us) write_op.cc:270] Start()
0429 19:54:49.879637 (+ 16us) write_op.cc:276] Timestamp: P: 1777492487006579 usec, L: 0
0429 19:54:49.879751 (+ 114us) write_op.cc:270] Start()
0429 19:54:49.879767 (+ 16us) write_op.cc:276] Timestamp: P: 1777492487011610 usec, L: 0
0429 19:54:49.879906 (+ 139us) write_op.cc:270] Start()
0429 19:54:49.879923 (+ 17us) write_op.cc:276] Timestamp: P: 1777492487034663 usec, L: 0
0429 19:54:49.895212 (+ 15289us) write_op.cc:270] Start()
0429 19:54:49.895240 (+ 28us) write_op.cc:276] Timestamp: P: 1777492487084785 usec, L: 0
0429 19:54:49.900614 (+ 5374us) write_op.cc:270] Start()
0429 19:54:49.900640 (+ 26us) write_op.cc:276] Timestamp: P: 1777492487090186 usec, L: 0
0429 19:54:49.905696 (+ 5056us) write_op.cc:270] Start()
0429 19:54:49.905723 (+ 27us) write_op.cc:276] Timestamp: P: 1777492487108671 usec, L: 0
0429 19:54:49.908318 (+ 2595us) write_op.cc:270] Start()
0429 19:54:49.908343 (+ 25us) write_op.cc:276] Timestamp: P: 1777492487124446 usec, L: 0
0429 19:54:49.908507 (+ 164us) write_op.cc:270] Start()
0429 19:54:49.908528 (+ 21us) write_op.cc:276] Timestamp: P: 1777492487140891 usec, L: 0
0429 19:54:49.908677 (+ 149us) write_op.cc:270] Start()
0429 19:54:49.908697 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487148998 usec, L: 0
0429 19:54:49.908849 (+ 152us) write_op.cc:270] Start()
0429 19:54:49.908870 (+ 21us) write_op.cc:276] Timestamp: P: 1777492487177181 usec, L: 0
0429 19:54:49.909043 (+ 173us) write_op.cc:270] Start()
0429 19:54:49.909063 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487203209 usec, L: 0
0429 19:54:49.909215 (+ 152us) write_op.cc:270] Start()
0429 19:54:49.909234 (+ 19us) write_op.cc:276] Timestamp: P: 1777492487208117 usec, L: 0
0429 19:54:49.909377 (+ 143us) write_op.cc:270] Start()
0429 19:54:49.909397 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487208702 usec, L: 0
0429 19:54:49.909542 (+ 145us) write_op.cc:270] Start()
0429 19:54:49.909560 (+ 18us) write_op.cc:276] Timestamp: P: 1777492487236727 usec, L: 0
0429 19:54:49.909721 (+ 161us) write_op.cc:270] Start()
0429 19:54:49.909741 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487266094 usec, L: 0
0429 19:54:49.909906 (+ 165us) write_op.cc:270] Start()
0429 19:54:49.909925 (+ 19us) write_op.cc:276] Timestamp: P: 1777492487282706 usec, L: 0
0429 19:54:49.940661 (+ 30736us) write_op.cc:270] Start()
0429 19:54:49.940693 (+ 32us) write_op.cc:276] Timestamp: P: 1777492487288256 usec, L: 0
0429 19:54:49.948346 (+ 7653us) write_op.cc:270] Start()
0429 19:54:49.948375 (+ 29us) write_op.cc:276] Timestamp: P: 1777492487302593 usec, L: 0
0429 19:54:49.960943 (+ 12568us) write_op.cc:270] Start()
0429 19:54:49.960974 (+ 31us) write_op.cc:276] Timestamp: P: 1777492487334333 usec, L: 0
0429 19:54:49.973487 (+ 12513us) write_op.cc:270] Start()
0429 19:54:49.973517 (+ 30us) write_op.cc:276] Timestamp: P: 1777492487381307 usec, L: 0
0429 19:54:49.976075 (+ 2558us) write_op.cc:270] Start()
0429 19:54:49.976105 (+ 30us) write_op.cc:276] Timestamp: P: 1777492487385450 usec, L: 0
0429 19:54:49.978018 (+ 1913us) write_op.cc:270] Start()
0429 19:54:49.978045 (+ 27us) write_op.cc:276] Timestamp: P: 1777492487400175 usec, L: 0
0429 19:54:49.978209 (+ 164us) write_op.cc:270] Start()
0429 19:54:49.978231 (+ 22us) write_op.cc:276] Timestamp: P: 1777492487412298 usec, L: 0
0429 19:54:49.978367 (+ 136us) write_op.cc:270] Start()
0429 19:54:49.978413 (+ 46us) write_op.cc:276] Timestamp: P: 1777492487471290 usec, L: 0
0429 19:54:50.021754 (+ 43341us) write_op.cc:270] Start()
0429 19:54:50.021778 (+ 24us) write_op.cc:276] Timestamp: P: 1777492487478986 usec, L: 0
0429 19:54:50.030768 (+ 8990us) write_op.cc:270] Start()
0429 19:54:50.030793 (+ 25us) write_op.cc:276] Timestamp: P: 1777492487479562 usec, L: 0
0429 19:54:50.037067 (+ 6274us) write_op.cc:270] Start()
0429 19:54:50.037102 (+ 35us) write_op.cc:276] Timestamp: P: 1777492487486407 usec, L: 0
0429 19:54:50.037314 (+ 212us) write_op.cc:270] Start()
0429 19:54:50.037336 (+ 22us) write_op.cc:276] Timestamp: P: 1777492487548890 usec, L: 0
0429 19:54:50.037517 (+ 181us) write_op.cc:270] Start()
0429 19:54:50.037540 (+ 23us) write_op.cc:276] Timestamp: P: 1777492487562481 usec, L: 0
0429 19:54:50.037739 (+ 199us) write_op.cc:270] Start()
0429 19:54:50.037762 (+ 23us) write_op.cc:276] Timestamp: P: 1777492487578086 usec, L: 0
0429 19:54:50.038212 (+ 450us) write_op.cc:270] Start()
0429 19:54:50.038233 (+ 21us) write_op.cc:276] Timestamp: P: 1777492487580902 usec, L: 0
0429 19:54:50.038349 (+ 116us) write_op.cc:270] Start()
0429 19:54:50.038362 (+ 13us) write_op.cc:276] Timestamp: P: 1777492487634743 usec, L: 0
0429 19:54:50.038517 (+ 155us) write_op.cc:270] Start()
0429 19:54:50.038537 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487647265 usec, L: 0
0429 19:54:50.038681 (+ 144us) write_op.cc:270] Start()
0429 19:54:50.038702 (+ 21us) write_op.cc:276] Timestamp: P: 1777492487651247 usec, L: 0
0429 19:54:50.038903 (+ 201us) write_op.cc:270] Start()
0429 19:54:50.038926 (+ 23us) write_op.cc:276] Timestamp: P: 1777492487662561 usec, L: 0
0429 19:54:50.039108 (+ 182us) write_op.cc:270] Start()
0429 19:54:50.039128 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487697455 usec, L: 0
0429 19:54:50.039264 (+ 136us) write_op.cc:270] Start()
0429 19:54:50.039293 (+ 29us) write_op.cc:276] Timestamp: P: 1777492487720887 usec, L: 0
0429 19:54:50.039444 (+ 151us) write_op.cc:270] Start()
0429 19:54:50.039463 (+ 19us) write_op.cc:276] Timestamp: P: 1777492487732661 usec, L: 0
0429 19:54:50.039617 (+ 154us) write_op.cc:270] Start()
0429 19:54:50.039638 (+ 21us) write_op.cc:276] Timestamp: P: 1777492487742714 usec, L: 0
0429 19:54:50.039805 (+ 167us) write_op.cc:270] Start()
0429 19:54:50.039826 (+ 21us) write_op.cc:276] Timestamp: P: 1777492487758020 usec, L: 0
0429 19:54:50.040006 (+ 180us) write_op.cc:270] Start()
0429 19:54:50.040027 (+ 21us) write_op.cc:276] Timestamp: P: 1777492487783271 usec, L: 0
0429 19:54:50.040173 (+ 146us) write_op.cc:270] Start()
0429 19:54:50.040192 (+ 19us) write_op.cc:276] Timestamp: P: 1777492487794203 usec, L: 0
0429 19:54:50.040318 (+ 126us) write_op.cc:270] Start()
0429 19:54:50.040336 (+ 18us) write_op.cc:276] Timestamp: P: 1777492487825247 usec, L: 0
0429 19:54:50.040562 (+ 226us) write_op.cc:270] Start()
0429 19:54:50.040583 (+ 21us) write_op.cc:276] Timestamp: P: 1777492487845073 usec, L: 0
0429 19:54:50.041141 (+ 558us) write_op.cc:270] Start()
0429 19:54:50.041166 (+ 25us) write_op.cc:276] Timestamp: P: 1777492487884132 usec, L: 0
0429 19:54:50.041357 (+ 191us) write_op.cc:270] Start()
0429 19:54:50.041379 (+ 22us) write_op.cc:276] Timestamp: P: 1777492487898714 usec, L: 0
0429 19:54:50.041531 (+ 152us) write_op.cc:270] Start()
0429 19:54:50.041551 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487914788 usec, L: 0
0429 19:54:50.042150 (+ 599us) write_op.cc:270] Start()
0429 19:54:50.042181 (+ 31us) write_op.cc:276] Timestamp: P: 1777492487946813 usec, L: 0
0429 19:54:50.047959 (+ 5778us) write_op.cc:270] Start()
0429 19:54:50.047993 (+ 34us) write_op.cc:276] Timestamp: P: 1777492487971619 usec, L: 0
0429 19:54:50.091487 (+ 43494us) write_op.cc:270] Start()
0429 19:54:50.091528 (+ 41us) write_op.cc:276] Timestamp: P: 1777492487985381 usec, L: 0
0429 19:54:50.093198 (+ 1670us) write_op.cc:270] Start()
0429 19:54:50.093216 (+ 18us) write_op.cc:276] Timestamp: P: 1777492487991455 usec, L: 0
0429 19:54:50.093369 (+ 153us) write_op.cc:270] Start()
0429 19:54:50.093385 (+ 16us) write_op.cc:276] Timestamp: P: 1777492488036434 usec, L: 0
0429 19:54:50.093494 (+ 109us) write_op.cc:270] Start()
0429 19:54:50.093510 (+ 16us) write_op.cc:276] Timestamp: P: 1777492488053045 usec, L: 0
0429 19:54:50.093650 (+ 140us) write_op.cc:270] Start()
0429 19:54:50.093667 (+ 17us) write_op.cc:276] Timestamp: P: 1777492488072023 usec, L: 0
0429 19:54:50.093778 (+ 111us) write_op.cc:270] Start()
0429 19:54:50.093794 (+ 16us) write_op.cc:276] Timestamp: P: 1777492488088493 usec, L: 0
0429 19:54:50.095431 (+ 1637us) write_op.cc:270] Start()
0429 19:54:50.095460 (+ 29us) write_op.cc:276] Timestamp: P: 1777492488104990 usec, L: 0
0429 19:54:50.102637 (+ 7177us) write_op.cc:270] Start()
0429 19:54:50.102664 (+ 27us) write_op.cc:276] Timestamp: P: 1777492488136486 usec, L: 0
0429 19:54:50.105231 (+ 2567us) write_op.cc:270] Start()
0429 19:54:50.105260 (+ 29us) write_op.cc:276] Timestamp: P: 1777492488137563 usec, L: 0
0429 19:54:50.107203 (+ 1943us) write_op.cc:270] Start()
0429 19:54:50.107229 (+ 26us) write_op.cc:276] Timestamp: P: 1777492488143785 usec, L: 0
0429 19:54:50.107414 (+ 185us) write_op.cc:270] Start()
0429 19:54:50.107432 (+ 18us) write_op.cc:276] Timestamp: P: 1777492488161787 usec, L: 0
0429 19:54:50.107597 (+ 165us) write_op.cc:270] Start()
0429 19:54:50.107617 (+ 20us) write_op.cc:276] Timestamp: P: 1777492488212936 usec, L: 0
0429 19:54:50.107758 (+ 141us) write_op.cc:270] Start()
0429 19:54:50.107778 (+ 20us) write_op.cc:276] Timestamp: P: 1777492488222825 usec, L: 0
0429 19:54:50.107926 (+ 148us) write_op.cc:270] Start()
0429 19:54:50.107945 (+ 19us) write_op.cc:276] Timestamp: P: 1777492488223437 usec, L: 0
0429 19:54:50.108090 (+ 145us) write_op.cc:270] Start()
0429 19:54:50.108109 (+ 19us) write_op.cc:276] Timestamp: P: 1777492488230108 usec, L: 0
0429 19:54:50.108250 (+ 141us) write_op.cc:270] Start()
0429 19:54:50.108269 (+ 19us) write_op.cc:276] Timestamp: P: 17774924
I20260429 19:54:51.518432 11446 raft_consensus.cc:493] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:51.518640 11446 raft_consensus.cc:515] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:51.521351 10810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1000 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:51.526522 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1000 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:51.530921 11446 leader_election.cc:290] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:51.551069 11276 leader_election.cc:304] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:51.551755 11446 raft_consensus.cc:2749] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 19:54:51.567539 11446 raft_consensus.cc:493] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:51.567750 11446 raft_consensus.cc:515] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:51.634847 10810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1002 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:51.639724 11446 leader_election.cc:290] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:51.673390 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1002 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:51.679942 11276 leader_election.cc:304] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:51.680305 11446 raft_consensus.cc:2749] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260429 19:54:51.111233 11348 rpcz_store.cc:276] 0429 19:54:49.341191 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 19:54:49.342705 (+ 1514us) service_pool.cc:225] Handling call
0429 19:54:49.502067 (+159362us) raft_consensus.cc:1471] Updating replica for 236 ops
0429 19:54:49.655102 (+153035us) raft_consensus.cc:1534] Early marking committed up to index 766
0429 19:54:49.655248 (+ 146us) raft_consensus.cc:1539] Triggering prepare for 236 ops
0429 19:54:49.663168 (+ 7920us) write_op.cc:270] Start()
0429 19:54:49.663190 (+ 22us) write_op.cc:276] Timestamp: P: 1777492484429370 usec, L: 0
0429 19:54:49.714570 (+ 51380us) write_op.cc:270] Start()
0429 19:54:49.714591 (+ 21us) write_op.cc:276] Timestamp: P: 1777492484457709 usec, L: 0
0429 19:54:49.738566 (+ 23975us) write_op.cc:270] Start()
0429 19:54:49.738592 (+ 26us) write_op.cc:276] Timestamp: P: 1777492484497906 usec, L: 0
0429 19:54:49.738751 (+ 159us) write_op.cc:270] Start()
0429 19:54:49.738770 (+ 19us) write_op.cc:276] Timestamp: P: 1777492484498647 usec, L: 0
0429 19:54:49.744782 (+ 6012us) write_op.cc:270] Start()
0429 19:54:49.744807 (+ 25us) write_op.cc:276] Timestamp: P: 1777492484500040 usec, L: 0
0429 19:54:49.745882 (+ 1075us) write_op.cc:270] Start()
0429 19:54:49.745914 (+ 32us) write_op.cc:276] Timestamp: P: 1777492484516798 usec, L: 0
0429 19:54:49.747994 (+ 2080us) write_op.cc:270] Start()
0429 19:54:49.750655 (+ 2661us) write_op.cc:276] Timestamp: P: 1777492484550611 usec, L: 0
0429 19:54:49.750842 (+ 187us) write_op.cc:270] Start()
0429 19:54:49.750866 (+ 24us) write_op.cc:276] Timestamp: P: 1777492484556790 usec, L: 0
0429 19:54:49.751018 (+ 152us) write_op.cc:270] Start()
0429 19:54:49.751037 (+ 19us) write_op.cc:276] Timestamp: P: 1777492484566669 usec, L: 0
0429 19:54:49.751383 (+ 346us) write_op.cc:270] Start()
0429 19:54:49.751408 (+ 25us) write_op.cc:276] Timestamp: P: 1777492484568075 usec, L: 0
0429 19:54:49.751610 (+ 202us) write_op.cc:270] Start()
0429 19:54:49.751630 (+ 20us) write_op.cc:276] Timestamp: P: 1777492484603886 usec, L: 0
0429 19:54:49.751760 (+ 130us) write_op.cc:270] Start()
0429 19:54:49.751783 (+ 23us) write_op.cc:276] Timestamp: P: 1777492484618462 usec, L: 0
0429 19:54:49.751934 (+ 151us) write_op.cc:270] Start()
0429 19:54:49.751952 (+ 18us) write_op.cc:276] Timestamp: P: 1777492484634713 usec, L: 0
0429 19:54:49.752098 (+ 146us) write_op.cc:270] Start()
0429 19:54:49.752118 (+ 20us) write_op.cc:276] Timestamp: P: 1777492484651310 usec, L: 0
0429 19:54:49.752247 (+ 129us) write_op.cc:270] Start()
0429 19:54:49.752265 (+ 18us) write_op.cc:276] Timestamp: P: 1777492484663618 usec, L: 0
0429 19:54:49.752395 (+ 130us) write_op.cc:270] Start()
0429 19:54:49.752413 (+ 18us) write_op.cc:276] Timestamp: P: 1777492484706418 usec, L: 0
0429 19:54:49.752543 (+ 130us) write_op.cc:270] Start()
0429 19:54:49.752573 (+ 30us) write_op.cc:276] Timestamp: P: 1777492484714174 usec, L: 0
0429 19:54:49.758467 (+ 5894us) write_op.cc:270] Start()
0429 19:54:49.758501 (+ 34us) write_op.cc:276] Timestamp: P: 1777492484746855 usec, L: 0
0429 19:54:49.764266 (+ 5765us) write_op.cc:270] Start()
0429 19:54:49.764290 (+ 24us) write_op.cc:276] Timestamp: P: 1777492484764815 usec, L: 0
0429 19:54:49.767142 (+ 2852us) write_op.cc:270] Start()
0429 19:54:49.767172 (+ 30us) write_op.cc:276] Timestamp: P: 1777492484784298 usec, L: 0
0429 19:54:49.768942 (+ 1770us) write_op.cc:270] Start()
0429 19:54:49.768970 (+ 28us) write_op.cc:276] Timestamp: P: 1777492484825511 usec, L: 0
0429 19:54:49.775644 (+ 6674us) write_op.cc:270] Start()
0429 19:54:49.775664 (+ 20us) write_op.cc:276] Timestamp: P: 1777492484841752 usec, L: 0
0429 19:54:49.776814 (+ 1150us) write_op.cc:270] Start()
0429 19:54:49.782415 (+ 5601us) write_op.cc:276] Timestamp: P: 1777492484847624 usec, L: 0
0429 19:54:49.786636 (+ 4221us) write_op.cc:270] Start()
0429 19:54:49.786662 (+ 26us) write_op.cc:276] Timestamp: P: 1777492484897530 usec, L: 0
0429 19:54:49.786865 (+ 203us) write_op.cc:270] Start()
0429 19:54:49.786889 (+ 24us) write_op.cc:276] Timestamp: P: 1777492484923199 usec, L: 0
0429 19:54:49.787056 (+ 167us) write_op.cc:270] Start()
0429 19:54:49.787077 (+ 21us) write_op.cc:276] Timestamp: P: 1777492484965396 usec, L: 0
0429 19:54:49.787219 (+ 142us) write_op.cc:270] Start()
0429 19:54:49.787240 (+ 21us) write_op.cc:276] Timestamp: P: 1777492484981312 usec, L: 0
0429 19:54:49.787405 (+ 165us) write_op.cc:270] Start()
0429 19:54:49.787425 (+ 20us) write_op.cc:276] Timestamp: P: 1777492484981990 usec, L: 0
0429 19:54:49.818910 (+ 31485us) write_op.cc:270] Start()
0429 19:54:49.818943 (+ 33us) write_op.cc:276] Timestamp: P: 1777492484984517 usec, L: 0
0429 19:54:49.819169 (+ 226us) write_op.cc:270] Start()
0429 19:54:49.819190 (+ 21us) write_op.cc:276] Timestamp: P: 1777492485041100 usec, L: 0
0429 19:54:49.819426 (+ 236us) write_op.cc:270] Start()
0429 19:54:49.819447 (+ 21us) write_op.cc:276] Timestamp: P: 1777492485052381 usec, L: 0
0429 19:54:49.819612 (+ 165us) write_op.cc:270] Start()
0429 19:54:49.819633 (+ 21us) write_op.cc:276] Timestamp: P: 1777492485080328 usec, L: 0
0429 19:54:49.819816 (+ 183us) write_op.cc:270] Start()
0429 19:54:49.819849 (+ 33us) write_op.cc:276] Timestamp: P: 1777492485084012 usec, L: 0
0429 19:54:49.819995 (+ 146us) write_op.cc:270] Start()
0429 19:54:49.820014 (+ 19us) write_op.cc:276] Timestamp: P: 1777492485109155 usec, L: 0
0429 19:54:49.820159 (+ 145us) write_op.cc:270] Start()
0429 19:54:49.820182 (+ 23us) write_op.cc:276] Timestamp: P: 1777492485109745 usec, L: 0
0429 19:54:49.820364 (+ 182us) write_op.cc:270] Start()
0429 19:54:49.820385 (+ 21us) write_op.cc:276] Timestamp: P: 1777492485149769 usec, L: 0
0429 19:54:49.843301 (+ 22916us) write_op.cc:270] Start()
0429 19:54:49.843483 (+ 182us) write_op.cc:276] Timestamp: P: 1777492485151100 usec, L: 0
0429 19:54:49.848344 (+ 4861us) write_op.cc:270] Start()
0429 19:54:49.848368 (+ 24us) write_op.cc:276] Timestamp: P: 1777492485152604 usec, L: 0
0429 19:54:49.864319 (+ 15951us) write_op.cc:270] Start()
0429 19:54:49.864348 (+ 29us) write_op.cc:276] Timestamp: P: 1777492485161130 usec, L: 0
0429 19:54:49.873805 (+ 9457us) write_op.cc:270] Start()
0429 19:54:49.873830 (+ 25us) write_op.cc:276] Timestamp: P: 1777492485192483 usec, L: 0
0429 19:54:49.875698 (+ 1868us) write_op.cc:270] Start()
0429 19:54:49.875720 (+ 22us) write_op.cc:276] Timestamp: P: 1777492485206573 usec, L: 0
0429 19:54:49.876764 (+ 1044us) write_op.cc:270] Start()
0429 19:54:49.876785 (+ 21us) write_op.cc:276] Timestamp: P: 1777492485207442 usec, L: 0
0429 19:54:49.886035 (+ 9250us) write_op.cc:270] Start()
0429 19:54:49.886066 (+ 31us) write_op.cc:276] Timestamp: P: 1777492485238198 usec, L: 0
0429 19:54:49.895365 (+ 9299us) write_op.cc:270] Start()
0429 19:54:49.895379 (+ 14us) write_op.cc:276] Timestamp: P: 1777492485256366 usec, L: 0
0429 19:54:49.900826 (+ 5447us) write_op.cc:270] Start()
0429 19:54:49.900934 (+ 108us) write_op.cc:276] Timestamp: P: 1777492485273663 usec, L: 0
0429 19:54:49.906491 (+ 5557us) write_op.cc:270] Start()
0429 19:54:49.906518 (+ 27us) write_op.cc:276] Timestamp: P: 1777492485298097 usec, L: 0
0429 19:54:49.906691 (+ 173us) write_op.cc:270] Start()
0429 19:54:49.906713 (+ 22us) write_op.cc:276] Timestamp: P: 1777492485299073 usec, L: 0
0429 19:54:49.927407 (+ 20694us) write_op.cc:270] Start()
0429 19:54:49.927438 (+ 31us) write_op.cc:276] Timestamp: P: 1777492485341487 usec, L: 0
0429 19:54:49.933530 (+ 6092us) write_op.cc:270] Start()
0429 19:54:49.933564 (+ 34us) write_op.cc:276] Timestamp: P: 1777492485397048 usec, L: 0
0429 19:54:49.933762 (+ 198us) write_op.cc:270] Start()
0429 19:54:49.933783 (+ 21us) write_op.cc:276] Timestamp: P: 1777492485398799 usec, L: 0
0429 19:54:49.936639 (+ 2856us) write_op.cc:270] Start()
0429 19:54:49.936671 (+ 32us) write_op.cc:276] Timestamp: P: 1777492485399424 usec, L: 0
0429 19:54:49.936875 (+ 204us) write_op.cc:270] Start()
0429 19:54:49.936899 (+ 24us) write_op.cc:276] Timestamp: P: 1777492485443140 usec, L: 0
0429 19:54:49.973059 (+ 36160us) write_op.cc:270] Start()
0429 19:54:49.973089 (+ 30us) write_op.cc:276] Timestamp: P: 1777492485467923 usec, L: 0
0429 19:54:50.015588 (+ 42499us) write_op.cc:270] Start()
0429 19:54:50.015639 (+ 51us) write_op.cc:276] Timestamp: P: 1777492485472221 usec, L: 0
0429 19:54:50.021153 (+ 5514us) write_op.cc:270] Start()
0429 19:54:50.021184 (+ 31us) write_op.cc:276] Timestamp: P: 1777492485475139 usec, L: 0
0429 19:54:50.024567 (+ 3383us) write_op.cc:270] Start()
0429 19:54:50.024587 (+ 20us) write_op.cc:276] Timestamp: P: 1777492485502555 usec, L: 0
0429 19:54:50.024717 (+ 130us) write_op.cc:270] Start()
0429 19:54:50.024731 (+ 14us) write_op.cc:276] Timestamp: P: 1777492485530902 usec, L: 0
0429 19:54:50.030501 (+ 5770us) write_op.cc:270] Start()
0429 19:54:50.030534 (+ 33us) write_op.cc:276] Timestamp: P: 1777492485565599 usec, L: 0
0429 19:54:50.045808 (+ 15274us) write_op.cc:270] Start()
0429 19:54:50.045846 (+ 38us) write_op.cc:276] Timestamp: P: 1777492485568079 usec, L: 0
0429 19:54:50.046054 (+ 208us) write_op.cc:270] Start()
0429 19:54:50.048428 (+ 2374us) write_op.cc:276] Timestamp: P: 1777492485634450 usec, L: 0
0429 19:54:50.072677 (+ 24249us) write_op.cc:270] Start()
0429 19:54:50.072719 (+ 42us) write_op.cc:276] Timestamp: P: 1777492485673913 usec, L: 0
0429 19:54:50.076581 (+ 3862us) write_op.cc:270] Start()
0429 19:54:50.076631 (+ 50us) write_op.cc:276] Timestamp: P: 1777492485686210 usec, L: 0
0429 19:54:50.080179 (+ 3548us) write_op.cc:270] Start()
0429 19:54:50.080209 (+ 30us) write_op.cc:276] Timestamp: P: 1777492485697515 usec, L: 0
0429 19:54:50.088990 (+ 8781us) write_op.cc:270] Start()
0429 19:54:50.089021 (+ 31us) write_op.cc:276] Timestamp: P: 1777492485699139 usec, L: 0
0429 19:54:50.089218 (+ 197us) write_op.cc:270] Start()
0429 19:54:50.089241 (+ 23us) write_op.cc:276] Timestamp: P: 1777492485734678 usec, L: 0
0429 19:54:50.089404 (+ 163us) write_op.cc:270] Start()
0429 19:54:50.089425 (+ 21us) write_op.cc:276] Timestamp: P: 1777492485754971 usec, L: 0
0429 19:54:50.089587 (+ 162us) write_op.cc:270] Start()
0429 19:54:50.089610 (+ 23us) write_op.cc:276] Timestamp: P: 1777492485767253 usec, L: 0
0429 19:54:50.089741 (+ 131us) write_op.cc:270] Start()
0429 19:54:50.089759 (+ 18us) write_op.cc:276] Timestamp: P: 1777492485782635 usec, L: 0
0429 19:54:50.089892 (+ 133us) write_op.cc:270] Start()
0429 19:54:50.089911 (+ 19us) write_op.cc:276] Timestamp: P: 1777492485809419 usec, L: 0
0429 19:54:50.090264 (+ 353us) write_op.cc:270] Start()
0429 19:54:50.090293 (+ 29us) write_op.cc:276] Timestamp: P: 1777492485826803 usec, L: 0
0429 19:54:50.090515 (+ 222us) write_op.cc:270] Start()
0429 19:54:50.090538 (+ 23us) write_op.cc:276] Timestamp: P: 1777492485864459 usec, L: 0
0429 19:54:50.090740 (+ 202us) write_op.cc:270] Start()
0429 19:54:50.090763 (+ 23us) write_op.cc:276] Timestamp: P: 1777492485865114 usec, L: 0
0429 19:54:50.090900 (+ 137us) write_op.cc:270] Start()
0429 19:54:50.090918 (+ 18us) write_op.cc:276] Timestamp: P: 1777492485888078 usec, L: 0
0429 19:54:50.091070 (+ 152us) write_op.cc:270] Start()
0429 19:54:50.091087 (+ 17us) write_op.cc:276] Timestamp: P: 1777492485892213 usec, L: 0
0429 19:54:50.091235 (+ 148us) write_op.cc:270] Start()
0429 19:54:50.091252 (+ 17us) write_op.cc:276] Timestamp: P: 1777492485961223 usec, L: 0
0429 19:54:50.092963 (+ 1711us) write_op.cc:270] Start()
0429 19:54:50.093003 (+ 40us) write_op.cc:276] Timestamp: P: 1777492485961865 usec, L: 0
0429 19:54:50.096273 (+ 3270us) write_op.cc:270] Start()
0429 19:54:50.096297 (+ 24us) write_op.cc:276] Timestamp: P: 1777492485962455 usec, L: 0
0429 19:54:50.096471 (+ 174us) write_op.cc:270] Start()
0429 19:54:50.096492 (+ 21us) write_op.cc:276] Timestamp: P: 1777492485980437 usec, L: 0
0429 19:54:50.112525 (+ 16033us) write_op.cc:270] Start()
0429 19:54:50.112554 (+ 29us) write_op.cc:276] Timestamp: P: 1777492486003451 usec, L: 0
0429 19:54:50.139094 (+ 26540us) write_op.cc:270] Start()
0429 19:54:50.139122 (+ 28us) write_op.cc:276] Timestamp: P: 1777492486024134 usec, L: 0
0429 19:54:50.139320 (+ 198us) write_op.cc:270] Start()
0429 19:54:50.139343 (+ 23us) write_op.cc:276] Timestamp: P: 1777492486067077 usec, L: 0
0429 19:54:50.139492 (+ 149us) write_op.cc:270] Start()
0429 19:54:50.139509 (+ 17us) write_op.cc:276] Timestamp: P: 1777492486079620 usec, L: 0
0429 19:54:50.139652 (+ 143us) write_op.cc:270] Start()
0429 19:54:50.139672 (+ 20us) write_op.cc:276] Timestamp: P: 1777492486082709 usec, L: 0
0429 19:54:50.139824 (+ 152us) write_op.cc:270] Start()
0429 19:54:50.139844 (+ 20us) write_op.cc:276] Timestamp: P: 1777492486105550 usec, L: 0
0429 19:54:50.140024 (+ 180us) write_op.cc:270] Start()
0429 19:54:50.140044 (+ 20us) write_op.cc:276] Timestamp: P: 1777492486122521 usec, L: 0
0429 19:54:50.175816 (+ 35772us) write_op.cc:270] Start()
0429 19:54:50.175843 (+ 27us) write_op.cc:276] Timestamp: P: 1777492486186257 usec, L: 0
0429 19:54:50.204320 (+ 28477us) write_op.cc:270] Start()
0429 19:54:50.204353 (+ 33us) write_op.cc:276] Timestamp: P: 1777492486192254 usec, L: 0
0429 19:54:50.207401 (+ 3048us) write_op.cc:270] Start()
0429 19:54:50.207434 (+ 33us) write_op.cc:276] Timestamp: P: 1777492486218647 usec, L: 0
0429 19:54:50.208652 (+ 1218us) write_op.cc:270] Start()
0429 19:54:50.208683 (+ 31us) write_op.cc:276] Timestamp: P: 1777492486272283 usec, L: 0
0429 19:54:50.209851 (+ 1168us) write_op.cc:270] Start()
0429 19:54:50.209875 (+ 24us) write_op.cc:276] Timestamp: P: 1777492486277163 usec, L: 0
0429 19:54:50.217055 (+ 7180us) write_op.cc:270] Start()
0429 19:54:50.217081 (+ 26us) write_op.cc:276] Timestamp: P: 1777492486309626 usec, L: 0
0429 19:54:50.218571 (+ 1490us) write_op.cc:270] Start()
0429 19:54:50.218596 (+ 25us) write_op.cc:276] Timestamp: P: 1777492486315038 usec, L: 0
0429 19:54:50.233454 (+ 14858us) write_op.cc:270] Start()
0429 19:54:50.233479 (+ 25us) write_op.cc:276] Timestamp: P: 1777492486341891 usec, L: 0
0429 19:54:50.236711 (+ 3232us) write_op.cc:270] Start()
0429 19:54:50.236744 (+ 33us) write_op.cc:276] Timestamp: P: 1777492486374646 usec, L: 0
0429 19:54:50.240159 (+ 3415us) write_op.cc:270] Start()
0429 19:54:50.240188 (+ 29us) write_op.cc:276] Timestamp: P: 1777492486399676 usec, L: 0
0429 19:54:50.256440 (+ 16252us) write_op.cc:270] Start()
0429 19:54:50.256502 (+ 62us) write_op.cc:276] Timestamp: P: 1777492486423358 usec, L: 0
0429 19:54:50.256748 (+ 246us) write_op.cc:270] Start()
0429 19:54:50.256770 (+ 22us) write_op.cc:276] Timestamp: P: 1777492486448822 usec, L: 0
0429 19:54:50.256932 (+ 162us) write_op.cc:270] Start()
0429 19:54:50.256953 (+ 21us) write_op.cc:276] Timestamp: P: 1777492486482714 usec, L: 0
0429 19:54:50.257114 (+ 161us) write_op.cc:270] Start()
0429 19:54:50.257140 (+ 26us) write_op.cc:276] Timestamp: P: 1777492486503246 usec, L: 0
0429 19:54:50.257299 (+ 159us) write_op.cc:270] Start()
0429 19:54:50.257319 (+ 20us) write_op.cc:276] Timestamp: P: 1777492486519242 usec, L: 0
0429 19:54:50.257487 (+ 168us) write_op.cc:270] Start()
0429 19:54:50.257506 (+ 19us) write_op.cc:276] Timestamp: P: 1777492486519764 usec, L: 0
0429 19:54:50.262211 (+ 4705us) write_op.cc:270] Start()
0429 19:54:50.262240 (+ 29us) write_op.cc:276] Timestamp: P: 1777492486628441 usec, L: 0
0429 19:54:50.313522 (+ 51282us) write_op.cc:270] Start()
0429 19:54:50.313543 (+ 21us) write_op.cc:276] Timestamp: P: 1777492486653973 usec, L: 0
0429 19:54:50.340629 (+ 27086us) write_op.cc:270] Start()
0429 19:54:50.340658 (+ 29us) write_op.cc:276] Timestamp: P: 1777492486655237 usec, L: 0
0429 19:54:50.358443 (+ 17785us) write_op.cc:270] Start()
0429 19:54:50.358480 (+ 37us) write_op.cc:276] Timestamp: P: 1777492486656947 usec, L: 0
0429 19:54:50.361542 (+ 3062us) write_op.cc:270] Start()
0429 19:54:50.361572 (+ 30us) write_op.cc:276] Timestamp: P: 1777492486713596 usec, L: 0
0429 19:54:50.361787 (+ 215us) write_op.cc:270] Start()
0429 19:54:50.361808 (+ 21us) write_op.cc:276] Timestamp: P: 1777492486741285 usec, L: 0
0429 19:54:50.361973 (+ 165us) write_op.cc:270] Start()
0429 19:54:50.361993 (+ 20us) write_op.cc:276] Timestamp: P: 1777492486751302 usec, L: 0
0429 19:54:50.362127 (+ 134us) write_op.cc:270] Start()
0429 19:54:50.362145 (+ 18us) write_op.cc:276] Timestamp: P: 1777492486756039 usec, L: 0
0429 19:54:50.362273 (+ 128us) write_op.cc:270] Start()
0429 19:54:50.362294 (+ 21us) write_op.cc:276] Timestamp: P: 1777492486792072 usec, L: 0
0429 19:54:50.362492 (+ 198us) write_op.cc:270] Start()
0429 19:54:50.362522 (+ 30us) write_op.cc:276] Timestamp: P: 1777492486805077 usec, L: 0
0429 19:54:50.362696 (+ 174us) write_op.cc:270] Start()
0429 19:54:50.362716 (+ 20us) write_op.cc:276] Timestamp: P: 1777492486809073 usec, L: 0
0429 19:54:50.363996 (+ 1280us) write_op.cc:270] Start()
0429 19:54:50.364024 (+ 28us) write_op.cc:276] Timestamp: P: 1777492486809644 usec, L: 0
0429 19:54:50.364188 (+ 164us) write_op.cc:270] Start()
0429 19:54:50.364213 (+ 25us) write_op.cc:276] Timestamp: P: 1777492486851003 usec, L: 0
0429 19:54:50.364380 (+ 167us) write_op.cc:270] Start()
0429 19:54:50.364400 (+ 20us) write_op.cc:276] Timestamp: P: 1777492486858744 usec, L: 0
0429 19:54:50.364562 (+ 162us) write_op.cc:270] Start()
0429 19:54:50.364582 (+ 20us) write_op.cc:276] Timestamp: P: 1777492486880574 usec, L: 0
0429 19:54:50.364800 (+ 218us) write_op.cc:270] Start()
0429 19:54:50.364821 (+ 21us) write_op.cc:276] Timestamp: P: 1777492486886552 usec, L: 0
0429 19:54:50.365040 (+ 219us) write_op.cc:270] Start()
0429 19:54:50.365065 (+ 25us) write_op.cc:276] Timestamp: P: 1777492486943603 usec, L: 0
0429 19:54:50.366794 (+ 1729us) write_op.cc:270] Start()
0429 19:54:50.366861 (+ 67us) write_op.cc:276] Timestamp: P: 1777492486944585 usec, L: 0
0429 19:54:50.367162 (+ 301us) write_op.cc:270] Start()
0429 19:54:50.367190 (+ 28us) write_op.cc:276] Timestamp: P: 1777492486991275 usec, L: 0
0429 19:54:50.367369 (+ 179us) write_op.cc:270] Start()
0429 19:54:50.367391 (+ 22us) write_op.cc:276] Timestamp: P: 1777492487005413 usec, L: 0
0429 19:54:50.367556 (+ 165us) write_op.cc:270] Start()
0429 19:54:50.367576 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487011710 usec, L: 0
0429 19:54:50.367757 (+ 181us) write_op.cc:270] Start()
0429 19:54:50.367778 (+ 21us) write_op.cc:276] Timestamp: P: 1777492487037240 usec, L: 0
0429 19:54:50.367967 (+ 189us) write_op.cc:270] Start()
0429 19:54:50.367987 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487087254 usec, L: 0
0429 19:54:50.368126 (+ 139us) write_op.cc:270] Start()
0429 19:54:50.368147 (+ 21us) write_op.cc:276] Timestamp: P: 1777492487095352 usec, L: 0
0429 19:54:50.368288 (+ 141us) write_op.cc:270] Start()
0429 19:54:50.368308 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487104750 usec, L: 0
0429 19:54:50.368471 (+ 163us) write_op.cc:270] Start()
0429 19:54:50.368492 (+ 21us) write_op.cc:276] Timestamp: P: 1777492487131946 usec, L: 0
0429 19:54:50.368666 (+ 174us) write_op.cc:270] Start()
0429 19:54:50.368686 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487140350 usec, L: 0
0429 19:54:50.374667 (+ 5981us) write_op.cc:270] Start()
0429 19:54:50.376489 (+ 1822us) write_op.cc:276] Timestamp: P: 1777492487160403 usec, L: 0
0429 19:54:50.376650 (+ 161us) write_op.cc:270] Start()
0429 19:54:50.376672 (+ 22us) write_op.cc:276] Timestamp: P: 1777492487188930 usec, L: 0
0429 19:54:50.394201 (+ 17529us) write_op.cc:270] Start()
0429 19:54:50.394276 (+ 75us) write_op.cc:276] Timestamp: P: 1777492487207557 usec, L: 0
0429 19:54:50.394551 (+ 275us) write_op.cc:270] Start()
0429 19:54:50.394578 (+ 27us) write_op.cc:276] Timestamp: P: 1777492487209328 usec, L: 0
0429 19:54:50.394728 (+ 150us) write_op.cc:270] Start()
0429 19:54:50.394748 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487232524 usec, L: 0
0429 19:54:50.394925 (+ 177us) write_op.cc:270] Start()
0429 19:54:50.394945 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487235682 usec, L: 0
0429 19:54:50.395099 (+ 154us) write_op.cc:270] Start()
0429 19:54:50.395119 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487268364 usec, L: 0
0429 19:54:50.395262 (+ 143us) write_op.cc:270] Start()
0429 19:54:50.395282 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487287745 usec, L: 0
0429 19:54:50.395471 (+ 189us) write_op.cc:270] Start()
0429 19:54:50.395498 (+ 27us) write_op.cc:276] Timestamp: P: 1777492487290780 usec, L: 0
0429 19:54:50.395687 (+ 189us) write_op.cc:270] Start()
0429 19:54:50.395710 (+ 23us) write_op.cc:276] Timestamp: P: 1777492487312529 usec, L: 0
0429 19:54:50.395872 (+ 162us) write_op.cc:270] Start()
0429 19:54:50.395893 (+ 21us) write_op.cc:276] Timestamp: P: 1777492487335307 usec, L: 0
0429 19:54:50.396068 (+ 175us) write_op.cc:270] Start()
0429 19:54:50.396089 (+ 21us) write_op.cc:276] Timestamp: P: 1777492487384016 usec, L: 0
0429 19:54:50.396227 (+ 138us) write_op.cc:270] Start()
0429 19:54:50.396246 (+ 19us) write_op.cc:276] Timestamp: P: 1777492487411524 usec, L: 0
0429 19:54:50.396388 (+ 142us) write_op.cc:270] Start()
0429 19:54:50.396407 (+ 19us) write_op.cc:276] Timestamp: P: 1777492487412215 usec, L: 0
0429 19:54:50.396540 (+ 133us) write_op.cc:270] Start()
0429 19:54:50.396559 (+ 19us) write_op.cc:276] Timestamp: P: 1777492487429245 usec, L: 0
0429 19:54:50.396694 (+ 135us) write_op.cc:270] Start()
0429 19:54:50.396715 (+ 21us) write_op.cc:276] Timestamp: P: 1777492487493589 usec, L: 0
0429 19:54:50.396863 (+ 148us) write_op.cc:270] Start()
0429 19:54:50.396882 (+ 19us) write_op.cc:276] Timestamp: P: 1777492487505104 usec, L: 0
0429 19:54:50.397047 (+ 165us) write_op.cc:270] Start()
0429 19:54:50.397073 (+ 26us) write_op.cc:276] Timestamp: P: 1777492487516848 usec, L: 0
0429 19:54:50.397217 (+ 144us) write_op.cc:270] Start()
0429 19:54:50.397235 (+ 18us) write_op.cc:276] Timestamp: P: 1777492487531110 usec, L: 0
0429 19:54:50.397404 (+ 169us) write_op.cc:270] Start()
0429 19:54:50.397424 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487554169 usec, L: 0
0429 19:54:50.397553 (+ 129us) write_op.cc:270] Start()
0429 19:54:50.397572 (+ 19us) write_op.cc:276] Timestamp: P: 1777492487579709 usec, L: 0
0429 19:54:50.397717 (+ 145us) write_op.cc:270] Start()
0429 19:54:50.397736 (+ 19us) write_op.cc:276] Timestamp: P: 1777492487588584 usec, L: 0
0429 19:54:50.397864 (+ 128us) write_op.cc:270] Start()
0429 19:54:50.397882 (+ 18us) write_op.cc:276] Timestamp: P: 1777492487589683 usec, L: 0
0429 19:54:50.398015 (+ 133us) write_op.cc:270] Start()
0429 19:54:50.398031 (+ 16us) write_op.cc:276] Timestamp: P: 1777492487649044 usec, L: 0
0429 19:54:50.398146 (+ 115us) write_op.cc:270] Start()
0429 19:54:50.398162 (+ 16us) write_op.cc:276] Timestamp: P: 1777492487655988 usec, L: 0
0429 19:54:50.398276 (+ 114us) write_op.cc:270] Start()
0429 19:54:50.398292 (+ 16us) write_op.cc:276] Timestamp: P: 1777492487656694 usec, L: 0
0429 19:54:50.433264 (+ 34972us) write_op.cc:270] Start()
0429 19:54:50.433294 (+ 30us) write_op.cc:276] Timestamp: P: 1777492487672195 usec, L: 0
0429 19:54:50.439582 (+ 6288us) write_op.cc:270] Start()
0429 19:54:50.439617 (+ 35us) write_op.cc:276] Timestamp: P: 1777492487718409 usec, L: 0
0429 19:54:50.439825 (+ 208us) write_op.cc:270] Start()
0429 19:54:50.439847 (+ 22us) write_op.cc:276] Timestamp: P: 1777492487720679 usec, L: 0
0429 19:54:50.440014 (+ 167us) write_op.cc:270] Start()
0429 19:54:50.440034 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487735448 usec, L: 0
0429 19:54:50.440208 (+ 174us) write_op.cc:270] Start()
0429 19:54:50.440228 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487761820 usec, L: 0
0429 19:54:50.440381 (+ 153us) write_op.cc:270] Start()
0429 19:54:50.440401 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487798172 usec, L: 0
0429 19:54:50.440573 (+ 172us) write_op.cc:270] Start()
0429 19:54:50.440599 (+ 26us) write_op.cc:276] Timestamp: P: 1777492487798807 usec, L: 0
0429 19:54:50.440738 (+ 139us) write_op.cc:270] Start()
0429 19:54:50.440757 (+ 19us) write_op.cc:276] Timestamp: P: 1777492487800447 usec, L: 0
0429 19:54:50.440896 (+ 139us) write_op.cc:270] Start()
0429 19:54:50.440925 (+ 29us) write_op.cc:276] Timestamp: P: 1777492487832539 usec, L: 0
0429 19:54:50.496048 (+ 55123us) write_op.cc:270] Start()
0429 19:54:50.496079 (+ 31us) write_op.cc:276] Timestamp: P: 1777492487894798 usec, L: 0
0429 19:54:50.496269 (+ 190us) write_op.cc:270] Start()
0429 19:54:50.496290 (+ 21us) write_op.cc:276] Timestamp: P: 1777492487906554 usec, L: 0
0429 19:54:50.500078 (+ 3788us) write_op.cc:270] Start()
0429 19:54:50.500102 (+ 24us) write_op.cc:276] Timestamp: P: 1777492487909507 usec, L: 0
0429 19:54:50.514002 (+ 13900us) write_op.cc:270] Start()
0429 19:54:50.514034 (+ 32us) write_op.cc:276] Timestamp: P: 1777492487917222 usec, L: 0
0429 19:54:50.516136 (+ 2102us) write_op.cc:270] Start()
0429 19:54:50.516165 (+ 29us) write_op.cc:276] Timestamp: P: 1777492487947090 usec, L: 0
0429 19:54:50.561285 (+ 45120us) write_op.cc:270] Start()
0429 19:54:50.561316 (+ 31us) write_op.cc:276] Timestamp: P: 1777492487980619 usec, L: 0
0429 19:54:50.563807 (+ 2491us) write_op.cc:270] Start()
0429 19:54:50.563837 (+ 30us) write_op.cc:276] Timestamp: P: 1777492488017157 usec, L: 0
0429 19:54:50.564031 (+ 194us) write_op.cc:270] Start()
0429 19:54:50.564055 (+ 24us) write_op.cc:276] Timestamp: P: 1777492488019082 usec, L: 0
0429 19:54:50.587296 (+ 23241us) write_op.cc:270] Start()
0429 19:54:50.587408 (+ 112us) write_op.cc:276] Timestamp: P: 1777492488038702 usec, L: 0
0429 19:54:50.594494 (+ 7086us) write_op.cc:270] Start()
0429 19:54:50.594516 (+ 22us) write_op.cc:276] Timestamp: P: 1777492488056035 usec, L: 0
0429 19:54:50.594688 (+ 172us) write_op.cc:270] Start()
0429 19:54:50.594709 (+ 21us) write_op.cc:276] Timestamp: P: 1777492488078814 usec, L: 0
0429 19:54:50.594850 (+ 141us) write_op.cc:270] Start()
0429 19:54:50.594869 (+ 19us) write_op.cc:276] Timestamp: P: 1777492488091603 usec, L: 0
0429 19:54:50.595001 (+ 132us) write_op.cc:270] Start()
0429 19:54:50.595019 (+ 18us) write_op.cc:276] Timestamp: P: 1777492488118051 usec, L: 0
0429 19:54:50.595183 (+ 164us) write_op.cc:270] Start()
0429 19:54:50.595205 (+ 22us) write_op.cc:276] Timestamp: P: 1777492488136644 usec, L: 0
0429 19:54:50.595343 (+ 138us) write_op.cc:270] Start()
0429 19:54:50.595361 (+ 18us) write_op.cc:276] Timestamp: P: 1777492488146655 usec, L: 0
0429 19:54:50.595487 (+ 126us) write_op.cc:270] Start()
0429 19:54:50.595561 (+ 74us) write_op.cc:276] Timestamp: P: 1777492488147858 usec, L: 0
0429 19:54:50.595737 (+ 176us) write_op.cc:270] Start()
0429 19:54:50.595759 (+ 22us) write_op.cc:276] Timestamp: P: 1777492488180789 usec, L: 0
0429 19:54:50.595923 (+ 164us) write_op.cc:270] Start()
0429 19:54:50.595944 (+ 21us) write_op.cc:276] Timestamp: P: 1777492488219884 usec, L: 0
0429 19:54:50.599155 (+ 3211us) write_op.cc:270] Start()
0429 19:54:50.599199 (+ 44us) write_op.cc:276] Timestamp: P: 1777492488222454 usec, L: 0
0429 19:54:50.599411 (+ 212us) write_op.cc:270] Start()
0429 19:54:50.599434 (+ 23us) write_op.cc:276] Timestamp: P: 1777492488229413 usec, L: 0
0429 19:54:50.599585 (+ 151us) write_op.cc:270] Start()
0429 19:54:50.599609 (+ 24us) write_op.cc:276] Timestamp: P: 1777492488236211 usec, L: 0
0429 19:54:50.599778 (+ 169us) write_op.cc:270] Start()
0429 19:54:50.599800 (+ 22us) write_op.cc:276] Timestamp: P: 1777492488274651 usec, L: 0
0429 19:54:50.644546 (+ 44746us) write_op.cc:270] Start()
0429 19:54:50.644569 (+ 23us) write_op.cc:276] Timestamp: P: 1777492488277404 usec, L: 0
0429 19:54:50.644771 (+ 202us) write_op.cc:270] Start()
0429 19:54:50.644792 (+ 21us) write_op.cc:276] Timestamp: P: 1777492488325501 usec, L: 0
0429 19:54:50.644946 (+ 154us) write_op.cc:270] Start()
0429 19:54:50.644967 (+ 21us) write_op.cc:276] Timestamp: P: 1777492488326270 usec, L: 0
0429 19:54:50.645211 (+ 244us) write_op.cc:270] Start()
0429 19:54:50.645232 (+ 21us) write_op.cc:276] Timestamp: P: 1777492488330692 usec, L: 0
0429 19:54:50.645380 (+ 148us) write_op.cc:270] Start()
0429 19:54:50.645401 (+ 21us) write_op.cc:276] Timestamp: P: 1777492488333419 usec, L: 0
0429 19:54:50.645558 (+ 157us) write_op.cc:270] Start()
0429 19:54:50.645579 (+ 21us) write_op.cc:276] Timestamp: P: 1777492488396719 usec, L: 0
0429 19:54:50.645734 (+ 155us) write_op.cc:270] Start()
0429 19:54:50.645755 (+ 21us) write_op.cc:276] Timestamp: P: 1777492488434684 usec, L: 0
0429 19:54:50.645918 (+ 163us) write_op.cc:270] Start()
0429 19:54:50.645940 (+ 22us) write_op.cc:276] Timestamp: P: 1777492488450135 usec, L: 0
0429 19:54:50.646076 (+ 136us) write_op.cc:270] Start()
0429 19:54:50.646094 (+ 18us) write_op.cc:276] Timestamp: P: 1777492488459960 usec, L: 0
0429 19:54:50.646233 (+ 139us) write_op.cc:270] Start()
0429 19:54:50.646253 (+ 20us) write_op.cc:276] Timestamp: P: 1777492488493377 usec, L: 0
0429 19:54:50.646426 (+ 173us) write_op.cc:270] Start()
0429 19:54:50.646446 (+ 20us) write_op.cc:276] Timestamp: P: 1777492488499734 usec, L: 0
0429 19:54:50.646582 (+ 136us) write_op.cc:270] Start()
0429 19:54:50.646601 (+ 19us) write_op.cc:276] Timestamp: P: 177749
I20260429 19:54:51.818028 11446 raft_consensus.cc:493] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9b091bf2bbc547978432dfe2dbc1ffcd)
I20260429 19:54:51.818233 11446 raft_consensus.cc:515] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:51.819494 10809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1094 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:51.822145 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815a20bb06ab452d8dcf0ca2592b5f5d" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1094 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:51.822754 11276 leader_election.cc:304] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:51.822902 11446 leader_election.cc:290] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:51.827533 11446 raft_consensus.cc:2749] T 815a20bb06ab452d8dcf0ca2592b5f5d P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260429 19:54:51.973896 11446 raft_consensus.cc:493] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:51.978266 11446 raft_consensus.cc:515] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:51.986078 10677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1000 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:51.986907 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1000 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:51.990566 11446 leader_election.cc:290] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:51.997615 11276 leader_election.cc:304] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:52.029181 11446 raft_consensus.cc:2749] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 19:54:51.102880 11353 rpcz_store.cc:276] 0429 19:54:49.274531 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 19:54:49.274594 (+ 63us) service_pool.cc:225] Handling call
0429 19:54:49.377861 (+103267us) raft_consensus.cc:1471] Updating replica for 238 ops
0429 19:54:49.538126 (+160265us) raft_consensus.cc:1534] Early marking committed up to index 0
0429 19:54:49.538131 (+ 5us) raft_consensus.cc:1539] Triggering prepare for 238 ops
0429 19:54:49.538261 (+ 130us) write_op.cc:270] Start()
0429 19:54:49.538297 (+ 36us) write_op.cc:276] Timestamp: P: 1777492484386796 usec, L: 0
0429 19:54:49.538582 (+ 285us) write_op.cc:270] Start()
0429 19:54:49.538608 (+ 26us) write_op.cc:276] Timestamp: P: 1777492484387917 usec, L: 0
0429 19:54:49.538777 (+ 169us) write_op.cc:270] Start()
0429 19:54:49.538809 (+ 32us) write_op.cc:276] Timestamp: P: 1777492484406332 usec, L: 0
0429 19:54:49.538952 (+ 143us) write_op.cc:270] Start()
0429 19:54:49.538972 (+ 20us) write_op.cc:276] Timestamp: P: 1777492484424892 usec, L: 0
0429 19:54:49.539138 (+ 166us) write_op.cc:270] Start()
0429 19:54:49.539157 (+ 19us) write_op.cc:276] Timestamp: P: 1777492484447145 usec, L: 0
0429 19:54:49.539314 (+ 157us) write_op.cc:270] Start()
0429 19:54:49.539333 (+ 19us) write_op.cc:276] Timestamp: P: 1777492484497374 usec, L: 0
0429 19:54:49.539518 (+ 185us) write_op.cc:270] Start()
0429 19:54:49.539570 (+ 52us) write_op.cc:276] Timestamp: P: 1777492484498554 usec, L: 0
0429 19:54:49.539701 (+ 131us) write_op.cc:270] Start()
0429 19:54:49.539720 (+ 19us) write_op.cc:276] Timestamp: P: 1777492484504104 usec, L: 0
0429 19:54:49.564874 (+ 25154us) write_op.cc:270] Start()
0429 19:54:49.564909 (+ 35us) write_op.cc:276] Timestamp: P: 1777492484516164 usec, L: 0
0429 19:54:49.565139 (+ 230us) write_op.cc:270] Start()
0429 19:54:49.565287 (+ 148us) write_op.cc:276] Timestamp: P: 1777492484549981 usec, L: 0
0429 19:54:49.565521 (+ 234us) write_op.cc:270] Start()
0429 19:54:49.565544 (+ 23us) write_op.cc:276] Timestamp: P: 1777492484566520 usec, L: 0
0429 19:54:49.571316 (+ 5772us) write_op.cc:270] Start()
0429 19:54:49.571348 (+ 32us) write_op.cc:276] Timestamp: P: 1777492484567876 usec, L: 0
0429 19:54:49.573285 (+ 1937us) write_op.cc:270] Start()
0429 19:54:49.573314 (+ 29us) write_op.cc:276] Timestamp: P: 1777492484568985 usec, L: 0
0429 19:54:49.573523 (+ 209us) write_op.cc:270] Start()
0429 19:54:49.573545 (+ 22us) write_op.cc:276] Timestamp: P: 1777492484604909 usec, L: 0
0429 19:54:49.575032 (+ 1487us) write_op.cc:270] Start()
0429 19:54:49.575059 (+ 27us) write_op.cc:276] Timestamp: P: 1777492484631873 usec, L: 0
0429 19:54:49.575194 (+ 135us) write_op.cc:270] Start()
0429 19:54:49.575211 (+ 17us) write_op.cc:276] Timestamp: P: 1777492484634047 usec, L: 0
0429 19:54:49.575378 (+ 167us) write_op.cc:270] Start()
0429 19:54:49.575396 (+ 18us) write_op.cc:276] Timestamp: P: 1777492484651193 usec, L: 0
0429 19:54:49.575576 (+ 180us) write_op.cc:270] Start()
0429 19:54:49.575598 (+ 22us) write_op.cc:276] Timestamp: P: 1777492484661412 usec, L: 0
0429 19:54:49.612451 (+ 36853us) write_op.cc:270] Start()
0429 19:54:49.612476 (+ 25us) write_op.cc:276] Timestamp: P: 1777492484702646 usec, L: 0
0429 19:54:49.612630 (+ 154us) write_op.cc:270] Start()
0429 19:54:49.612648 (+ 18us) write_op.cc:276] Timestamp: P: 1777492484706058 usec, L: 0
0429 19:54:49.613725 (+ 1077us) write_op.cc:270] Start()
0429 19:54:49.613749 (+ 24us) write_op.cc:276] Timestamp: P: 1777492484739819 usec, L: 0
0429 19:54:49.620149 (+ 6400us) write_op.cc:270] Start()
0429 19:54:49.620190 (+ 41us) write_op.cc:276] Timestamp: P: 1777492484766585 usec, L: 0
0429 19:54:49.625734 (+ 5544us) write_op.cc:270] Start()
0429 19:54:49.625772 (+ 38us) write_op.cc:276] Timestamp: P: 1777492484780814 usec, L: 0
0429 19:54:49.643221 (+ 17449us) write_op.cc:270] Start()
0429 19:54:49.643250 (+ 29us) write_op.cc:276] Timestamp: P: 1777492484824739 usec, L: 0
0429 19:54:49.647612 (+ 4362us) write_op.cc:270] Start()
0429 19:54:49.647659 (+ 47us) write_op.cc:276] Timestamp: P: 1777492484841110 usec, L: 0
0429 19:54:49.647841 (+ 182us) write_op.cc:270] Start()
0429 19:54:49.647864 (+ 23us) write_op.cc:276] Timestamp: P: 1777492484841762 usec, L: 0
0429 19:54:49.648018 (+ 154us) write_op.cc:270] Start()
0429 19:54:49.648037 (+ 19us) write_op.cc:276] Timestamp: P: 1777492484898162 usec, L: 0
0429 19:54:49.648184 (+ 147us) write_op.cc:270] Start()
0429 19:54:49.648204 (+ 20us) write_op.cc:276] Timestamp: P: 1777492484922592 usec, L: 0
0429 19:54:49.661160 (+ 12956us) write_op.cc:270] Start()
0429 19:54:49.661186 (+ 26us) write_op.cc:276] Timestamp: P: 1777492484932495 usec, L: 0
0429 19:54:49.662751 (+ 1565us) write_op.cc:270] Start()
0429 19:54:49.662794 (+ 43us) write_op.cc:276] Timestamp: P: 1777492484959372 usec, L: 0
0429 19:54:49.662980 (+ 186us) write_op.cc:270] Start()
0429 19:54:49.663003 (+ 23us) write_op.cc:276] Timestamp: P: 1777492484974209 usec, L: 0
0429 19:54:49.664622 (+ 1619us) write_op.cc:270] Start()
0429 19:54:49.664651 (+ 29us) write_op.cc:276] Timestamp: P: 1777492484981832 usec, L: 0
0429 19:54:49.667430 (+ 2779us) write_op.cc:270] Start()
0429 19:54:49.667456 (+ 26us) write_op.cc:276] Timestamp: P: 1777492485018724 usec, L: 0
0429 19:54:49.669900 (+ 2444us) write_op.cc:270] Start()
0429 19:54:49.669927 (+ 27us) write_op.cc:276] Timestamp: P: 1777492485041116 usec, L: 0
0429 19:54:49.679817 (+ 9890us) write_op.cc:270] Start()
0429 19:54:49.679835 (+ 18us) write_op.cc:276] Timestamp: P: 1777492485079675 usec, L: 0
0429 19:54:49.686768 (+ 6933us) write_op.cc:270] Start()
0429 19:54:49.686800 (+ 32us) write_op.cc:276] Timestamp: P: 1777492485081528 usec, L: 0
0429 19:54:49.687007 (+ 207us) write_op.cc:270] Start()
0429 19:54:49.687029 (+ 22us) write_op.cc:276] Timestamp: P: 1777492485107246 usec, L: 0
0429 19:54:49.687173 (+ 144us) write_op.cc:270] Start()
0429 19:54:49.687192 (+ 19us) write_op.cc:276] Timestamp: P: 1777492485108976 usec, L: 0
0429 19:54:49.687358 (+ 166us) write_op.cc:270] Start()
0429 19:54:49.687379 (+ 21us) write_op.cc:276] Timestamp: P: 1777492485137872 usec, L: 0
0429 19:54:49.687536 (+ 157us) write_op.cc:270] Start()
0429 19:54:49.687566 (+ 30us) write_op.cc:276] Timestamp: P: 1777492485138783 usec, L: 0
0429 19:54:49.687732 (+ 166us) write_op.cc:270] Start()
0429 19:54:49.692370 (+ 4638us) write_op.cc:276] Timestamp: P: 1777492485153722 usec, L: 0
0429 19:54:49.694212 (+ 1842us) write_op.cc:270] Start()
0429 19:54:49.694241 (+ 29us) write_op.cc:276] Timestamp: P: 1777492485163632 usec, L: 0
0429 19:54:49.696633 (+ 2392us) write_op.cc:270] Start()
0429 19:54:49.696661 (+ 28us) write_op.cc:276] Timestamp: P: 1777492485191139 usec, L: 0
0429 19:54:49.698561 (+ 1900us) write_op.cc:270] Start()
0429 19:54:49.698593 (+ 32us) write_op.cc:276] Timestamp: P: 1777492485203352 usec, L: 0
0429 19:54:49.701225 (+ 2632us) write_op.cc:270] Start()
0429 19:54:49.701247 (+ 22us) write_op.cc:276] Timestamp: P: 1777492485219738 usec, L: 0
0429 19:54:49.717236 (+ 15989us) write_op.cc:270] Start()
0429 19:54:49.717261 (+ 25us) write_op.cc:276] Timestamp: P: 1777492485230584 usec, L: 0
0429 19:54:49.717414 (+ 153us) write_op.cc:270] Start()
0429 19:54:49.717432 (+ 18us) write_op.cc:276] Timestamp: P: 1777492485270145 usec, L: 0
0429 19:54:49.721638 (+ 4206us) write_op.cc:270] Start()
0429 19:54:49.721672 (+ 34us) write_op.cc:276] Timestamp: P: 1777492485274797 usec, L: 0
0429 19:54:49.734861 (+ 13189us) write_op.cc:270] Start()
0429 19:54:49.734894 (+ 33us) write_op.cc:276] Timestamp: P: 1777492485297166 usec, L: 0
0429 19:54:49.739150 (+ 4256us) write_op.cc:270] Start()
0429 19:54:49.739173 (+ 23us) write_op.cc:276] Timestamp: P: 1777492485298808 usec, L: 0
0429 19:54:49.751403 (+ 12230us) write_op.cc:270] Start()
0429 19:54:49.751422 (+ 19us) write_op.cc:276] Timestamp: P: 1777492485336477 usec, L: 0
0429 19:54:49.755003 (+ 3581us) write_op.cc:270] Start()
0429 19:54:49.755033 (+ 30us) write_op.cc:276] Timestamp: P: 1777492485386532 usec, L: 0
0429 19:54:49.755199 (+ 166us) write_op.cc:270] Start()
0429 19:54:49.755219 (+ 20us) write_op.cc:276] Timestamp: P: 1777492485398252 usec, L: 0
0429 19:54:49.760387 (+ 5168us) write_op.cc:270] Start()
0429 19:54:49.760414 (+ 27us) write_op.cc:276] Timestamp: P: 1777492485402197 usec, L: 0
0429 19:54:49.760607 (+ 193us) write_op.cc:270] Start()
0429 19:54:49.760629 (+ 22us) write_op.cc:276] Timestamp: P: 1777492485444720 usec, L: 0
0429 19:54:49.760794 (+ 165us) write_op.cc:270] Start()
0429 19:54:49.760819 (+ 25us) write_op.cc:276] Timestamp: P: 1777492485467242 usec, L: 0
0429 19:54:49.760968 (+ 149us) write_op.cc:270] Start()
0429 19:54:49.761009 (+ 41us) write_op.cc:276] Timestamp: P: 1777492485470526 usec, L: 0
0429 19:54:49.761183 (+ 174us) write_op.cc:270] Start()
0429 19:54:49.761204 (+ 21us) write_op.cc:276] Timestamp: P: 1777492485475173 usec, L: 0
0429 19:54:49.761361 (+ 157us) write_op.cc:270] Start()
0429 19:54:49.761381 (+ 20us) write_op.cc:276] Timestamp: P: 1777492485494573 usec, L: 0
0429 19:54:49.763536 (+ 2155us) write_op.cc:270] Start()
0429 19:54:49.763603 (+ 67us) write_op.cc:276] Timestamp: P: 1777492485532689 usec, L: 0
0429 19:54:49.763839 (+ 236us) write_op.cc:270] Start()
0429 19:54:49.763864 (+ 25us) write_op.cc:276] Timestamp: P: 1777492485569891 usec, L: 0
0429 19:54:49.764062 (+ 198us) write_op.cc:270] Start()
0429 19:54:49.764085 (+ 23us) write_op.cc:276] Timestamp: P: 1777492485573201 usec, L: 0
0429 19:54:49.765948 (+ 1863us) write_op.cc:270] Start()
0429 19:54:49.765974 (+ 26us) write_op.cc:276] Timestamp: P: 1777492485635865 usec, L: 0
0429 19:54:49.769271 (+ 3297us) write_op.cc:270] Start()
0429 19:54:49.769295 (+ 24us) write_op.cc:276] Timestamp: P: 1777492485651051 usec, L: 0
0429 19:54:49.771097 (+ 1802us) write_op.cc:270] Start()
0429 19:54:49.771124 (+ 27us) write_op.cc:276] Timestamp: P: 1777492485684764 usec, L: 0
0429 19:54:49.772580 (+ 1456us) write_op.cc:270] Start()
0429 19:54:49.772606 (+ 26us) write_op.cc:276] Timestamp: P: 1777492485697102 usec, L: 0
0429 19:54:49.775304 (+ 2698us) write_op.cc:270] Start()
0429 19:54:49.775331 (+ 27us) write_op.cc:276] Timestamp: P: 1777492485700021 usec, L: 0
0429 19:54:49.776737 (+ 1406us) write_op.cc:270] Start()
0429 19:54:49.776766 (+ 29us) write_op.cc:276] Timestamp: P: 1777492485731036 usec, L: 0
0429 19:54:49.820285 (+ 43519us) write_op.cc:270] Start()
0429 19:54:49.820318 (+ 33us) write_op.cc:276] Timestamp: P: 1777492485751292 usec, L: 0
0429 19:54:49.847695 (+ 27377us) write_op.cc:270] Start()
0429 19:54:49.847725 (+ 30us) write_op.cc:276] Timestamp: P: 1777492485765815 usec, L: 0
0429 19:54:49.847927 (+ 202us) write_op.cc:270] Start()
0429 19:54:49.847947 (+ 20us) write_op.cc:276] Timestamp: P: 1777492485783027 usec, L: 0
0429 19:54:49.851038 (+ 3091us) write_op.cc:270] Start()
0429 19:54:49.851065 (+ 27us) write_op.cc:276] Timestamp: P: 1777492485811629 usec, L: 0
0429 19:54:49.853563 (+ 2498us) write_op.cc:270] Start()
0429 19:54:49.865325 (+ 11762us) write_op.cc:276] Timestamp: P: 1777492485826202 usec, L: 0
0429 19:54:49.869507 (+ 4182us) write_op.cc:270] Start()
0429 19:54:49.869531 (+ 24us) write_op.cc:276] Timestamp: P: 1777492485865134 usec, L: 0
0429 19:54:49.870662 (+ 1131us) write_op.cc:270] Start()
0429 19:54:49.870686 (+ 24us) write_op.cc:276] Timestamp: P: 1777492485870180 usec, L: 0
0429 19:54:49.873995 (+ 3309us) write_op.cc:270] Start()
0429 19:54:49.874017 (+ 22us) write_op.cc:276] Timestamp: P: 1777492485886602 usec, L: 0
0429 19:54:49.874360 (+ 343us) write_op.cc:270] Start()
0429 19:54:49.874422 (+ 62us) write_op.cc:276] Timestamp: P: 1777492485889343 usec, L: 0
0429 19:54:49.875890 (+ 1468us) write_op.cc:270] Start()
0429 19:54:49.875911 (+ 21us) write_op.cc:276] Timestamp: P: 1777492485950582 usec, L: 0
0429 19:54:49.878751 (+ 2840us) write_op.cc:270] Start()
0429 19:54:49.878779 (+ 28us) write_op.cc:276] Timestamp: P: 1777492485963738 usec, L: 0
0429 19:54:49.890222 (+ 11443us) write_op.cc:270] Start()
0429 19:54:49.890247 (+ 25us) write_op.cc:276] Timestamp: P: 1777492485964313 usec, L: 0
0429 19:54:49.895554 (+ 5307us) write_op.cc:270] Start()
0429 19:54:49.895575 (+ 21us) write_op.cc:276] Timestamp: P: 1777492485979052 usec, L: 0
0429 19:54:49.895796 (+ 221us) write_op.cc:270] Start()
0429 19:54:49.895817 (+ 21us) write_op.cc:276] Timestamp: P: 1777492486005938 usec, L: 0
0429 19:54:49.895983 (+ 166us) write_op.cc:270] Start()
0429 19:54:49.896007 (+ 24us) write_op.cc:276] Timestamp: P: 1777492486054689 usec, L: 0
0429 19:54:49.896150 (+ 143us) write_op.cc:270] Start()
0429 19:54:49.896170 (+ 20us) write_op.cc:276] Timestamp: P: 1777492486063162 usec, L: 0
0429 19:54:49.896302 (+ 132us) write_op.cc:270] Start()
0429 19:54:49.896320 (+ 18us) write_op.cc:276] Timestamp: P: 1777492486072346 usec, L: 0
0429 19:54:49.925642 (+ 29322us) write_op.cc:270] Start()
0429 19:54:49.925667 (+ 25us) write_op.cc:276] Timestamp: P: 1777492486074097 usec, L: 0
0429 19:54:49.940124 (+ 14457us) write_op.cc:270] Start()
0429 19:54:49.940153 (+ 29us) write_op.cc:276] Timestamp: P: 1777492486123220 usec, L: 0
0429 19:54:49.943194 (+ 3041us) write_op.cc:270] Start()
0429 19:54:49.943223 (+ 29us) write_op.cc:276] Timestamp: P: 1777492486158578 usec, L: 0
0429 19:54:49.959172 (+ 15949us) write_op.cc:270] Start()
0429 19:54:49.972728 (+ 13556us) write_op.cc:276] Timestamp: P: 1777492486183717 usec, L: 0
0429 19:54:49.976389 (+ 3661us) write_op.cc:270] Start()
0429 19:54:49.976416 (+ 27us) write_op.cc:276] Timestamp: P: 1777492486187855 usec, L: 0
0429 19:54:49.976594 (+ 178us) write_op.cc:270] Start()
0429 19:54:49.976615 (+ 21us) write_op.cc:276] Timestamp: P: 1777492486219998 usec, L: 0
0429 19:54:49.978825 (+ 2210us) write_op.cc:270] Start()
0429 19:54:49.978850 (+ 25us) write_op.cc:276] Timestamp: P: 1777492486275385 usec, L: 0
0429 19:54:50.007748 (+ 28898us) write_op.cc:270] Start()
0429 19:54:50.007784 (+ 36us) write_op.cc:276] Timestamp: P: 1777492486279608 usec, L: 0
0429 19:54:50.015995 (+ 8211us) write_op.cc:270] Start()
0429 19:54:50.016022 (+ 27us) write_op.cc:276] Timestamp: P: 1777492486310898 usec, L: 0
0429 19:54:50.021978 (+ 5956us) write_op.cc:270] Start()
0429 19:54:50.022001 (+ 23us) write_op.cc:276] Timestamp: P: 1777492486316773 usec, L: 0
0429 19:54:50.023399 (+ 1398us) write_op.cc:270] Start()
0429 19:54:50.023428 (+ 29us) write_op.cc:276] Timestamp: P: 1777492486344198 usec, L: 0
0429 19:54:50.043827 (+ 20399us) write_op.cc:270] Start()
0429 19:54:50.043866 (+ 39us) write_op.cc:276] Timestamp: P: 1777492486371840 usec, L: 0
0429 19:54:50.046687 (+ 2821us) write_op.cc:270] Start()
0429 19:54:50.046721 (+ 34us) write_op.cc:276] Timestamp: P: 1777492486398054 usec, L: 0
0429 19:54:50.048944 (+ 2223us) write_op.cc:270] Start()
0429 19:54:50.048979 (+ 35us) write_op.cc:276] Timestamp: P: 1777492486418906 usec, L: 0
0429 19:54:50.073382 (+ 24403us) write_op.cc:270] Start()
0429 19:54:50.073413 (+ 31us) write_op.cc:276] Timestamp: P: 1777492486444795 usec, L: 0
0429 19:54:50.073604 (+ 191us) write_op.cc:270] Start()
0429 19:54:50.073627 (+ 23us) write_op.cc:276] Timestamp: P: 1777492486483869 usec, L: 0
0429 19:54:50.082267 (+ 8640us) write_op.cc:270] Start()
0429 19:54:50.082305 (+ 38us) write_op.cc:276] Timestamp: P: 1777492486505388 usec, L: 0
0429 19:54:50.093928 (+ 11623us) write_op.cc:270] Start()
0429 19:54:50.093944 (+ 16us) write_op.cc:276] Timestamp: P: 1777492486518638 usec, L: 0
0429 19:54:50.095489 (+ 1545us) write_op.cc:270] Start()
0429 19:54:50.095508 (+ 19us) write_op.cc:276] Timestamp: P: 1777492486522370 usec, L: 0
0429 19:54:50.102547 (+ 7039us) write_op.cc:270] Start()
0429 19:54:50.102945 (+ 398us) write_op.cc:276] Timestamp: P: 1777492486652185 usec, L: 0
0429 19:54:50.110544 (+ 7599us) write_op.cc:270] Start()
0429 19:54:50.110570 (+ 26us) write_op.cc:276] Timestamp: P: 1777492486654655 usec, L: 0
0429 19:54:50.110734 (+ 164us) write_op.cc:270] Start()
0429 19:54:50.110754 (+ 20us) write_op.cc:276] Timestamp: P: 1777492486655814 usec, L: 0
0429 19:54:50.123249 (+ 12495us) write_op.cc:270] Start()
0429 19:54:50.123284 (+ 35us) write_op.cc:276] Timestamp: P: 1777492486658067 usec, L: 0
0429 19:54:50.123470 (+ 186us) write_op.cc:270] Start()
0429 19:54:50.123490 (+ 20us) write_op.cc:276] Timestamp: P: 1777492486721019 usec, L: 0
0429 19:54:50.123652 (+ 162us) write_op.cc:270] Start()
0429 19:54:50.123674 (+ 22us) write_op.cc:276] Timestamp: P: 1777492486744046 usec, L: 0
0429 19:54:50.158529 (+ 34855us) write_op.cc:270] Start()
0429 19:54:50.158565 (+ 36us) write_op.cc:276] Timestamp: P: 1777492486754239 usec, L: 0
0429 19:54:50.158786 (+ 221us) write_op.cc:270] Start()
0429 19:54:50.158810 (+ 24us) write_op.cc:276] Timestamp: P: 1777492486756214 usec, L: 0
0429 19:54:50.158980 (+ 170us) write_op.cc:270] Start()
0429 19:54:50.159000 (+ 20us) write_op.cc:276] Timestamp: P: 1777492486791651 usec, L: 0
0429 19:54:50.159142 (+ 142us) write_op.cc:270] Start()
0429 19:54:50.159161 (+ 19us) write_op.cc:276] Timestamp: P: 1777492486798234 usec, L: 0
0429 19:54:50.159348 (+ 187us) write_op.cc:270] Start()
0429 19:54:50.159371 (+ 23us) write_op.cc:276] Timestamp: P: 1777492486812359 usec, L: 0
0429 19:54:50.159548 (+ 177us) write_op.cc:270] Start()
0429 19:54:50.159570 (+ 22us) write_op.cc:276] Timestamp: P: 1777492486821234 usec, L: 0
0429 19:54:50.159725 (+ 155us) write_op.cc:270] Start()
0429 19:54:50.159747 (+ 22us) write_op.cc:276] Timestamp: P: 1777492486853769 usec, L: 0
0429 19:54:50.159895 (+ 148us) write_op.cc:270] Start()
0429 19:54:50.159915 (+ 20us) write_op.cc:276] Timestamp: P: 1777492486854413 usec, L: 0
0429 19:54:50.160087 (+ 172us) write_op.cc:270] Start()
0429 19:54:50.160108 (+ 21us) write_op.cc:276] Timestamp: P: 1777492486877279 usec, L: 0
0429 19:54:50.160246 (+ 138us) write_op.cc:270] Start()
0429 19:54:50.160265 (+ 19us) write_op.cc:276] Timestamp: P: 1777492486888815 usec, L: 0
0429 19:54:50.160432 (+ 167us) write_op.cc:270] Start()
0429 19:54:50.160472 (+ 40us) write_op.cc:276] Timestamp: P: 1777492486931441 usec, L: 0
0429 19:54:50.160642 (+ 170us) write_op.cc:270] Start()
0429 19:54:50.160664 (+ 22us) write_op.cc:276] Timestamp: P: 1777492486948296 usec, L: 0
0429 19:54:50.160816 (+ 152us) write_op.cc:270] Start()
0429 19:54:50.160835 (+ 19us) write_op.cc:276] Timestamp: P: 1777492487000474 usec, L: 0
0429 19:54:50.161042 (+ 207us) write_op.cc:270] Start()
0429 19:54:50.161064 (+ 22us) write_op.cc:276] Timestamp: P: 1777492487001704 usec, L: 0
0429 19:54:50.161203 (+ 139us) write_op.cc:270] Start()
0429 19:54:50.161224 (+ 21us) write_op.cc:276] Timestamp: P: 1777492487007741 usec, L: 0
0429 19:54:50.161409 (+ 185us) write_op.cc:270] Start()
0429 19:54:50.161440 (+ 31us) write_op.cc:276] Timestamp: P: 1777492487017705 usec, L: 0
0429 19:54:50.161587 (+ 147us) write_op.cc:270] Start()
0429 19:54:50.161606 (+ 19us) write_op.cc:276] Timestamp: P: 1777492487106507 usec, L: 0
0429 19:54:50.161764 (+ 158us) write_op.cc:270] Start()
0429 19:54:50.161785 (+ 21us) write_op.cc:276] Timestamp: P: 1777492487107924 usec, L: 0
0429 19:54:50.162008 (+ 223us) write_op.cc:270] Start()
0429 19:54:50.162030 (+ 22us) write_op.cc:276] Timestamp: P: 1777492487123710 usec, L: 0
0429 19:54:50.162167 (+ 137us) write_op.cc:270] Start()
0429 19:54:50.162186 (+ 19us) write_op.cc:276] Timestamp: P: 1777492487134634 usec, L: 0
0429 19:54:50.162366 (+ 180us) write_op.cc:270] Start()
0429 19:54:50.172088 (+ 9722us) write_op.cc:276] Timestamp: P: 1777492487143559 usec, L: 0
0429 19:54:50.173532 (+ 1444us) write_op.cc:270] Start()
0429 19:54:50.173559 (+ 27us) write_op.cc:276] Timestamp: P: 1777492487167094 usec, L: 0
0429 19:54:50.177432 (+ 3873us) write_op.cc:270] Start()
0429 19:54:50.177458 (+ 26us) write_op.cc:276] Timestamp: P: 1777492487179830 usec, L: 0
0429 19:54:50.178124 (+ 666us) write_op.cc:270] Start()
0429 19:54:50.178149 (+ 25us) write_op.cc:276] Timestamp: P: 1777492487209232 usec, L: 0
0429 19:54:50.178297 (+ 148us) write_op.cc:270] Start()
0429 19:54:50.178317 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487209858 usec, L: 0
0429 19:54:50.178488 (+ 171us) write_op.cc:270] Start()
0429 19:54:50.178508 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487228670 usec, L: 0
0429 19:54:50.236937 (+ 58429us) write_op.cc:270] Start()
0429 19:54:50.236966 (+ 29us) write_op.cc:276] Timestamp: P: 1777492487237597 usec, L: 0
0429 19:54:50.242131 (+ 5165us) write_op.cc:270] Start()
0429 19:54:50.242157 (+ 26us) write_op.cc:276] Timestamp: P: 1777492487264847 usec, L: 0
0429 19:54:50.243524 (+ 1367us) write_op.cc:270] Start()
0429 19:54:50.243541 (+ 17us) write_op.cc:276] Timestamp: P: 1777492487287038 usec, L: 0
0429 19:54:50.261288 (+ 17747us) write_op.cc:270] Start()
0429 19:54:50.261318 (+ 30us) write_op.cc:276] Timestamp: P: 1777492487296897 usec, L: 0
0429 19:54:50.261502 (+ 184us) write_op.cc:270] Start()
0429 19:54:50.261525 (+ 23us) write_op.cc:276] Timestamp: P: 1777492487313897 usec, L: 0
0429 19:54:50.265829 (+ 4304us) write_op.cc:270] Start()
0429 19:54:50.265857 (+ 28us) write_op.cc:276] Timestamp: P: 1777492487337020 usec, L: 0
0429 19:54:50.266951 (+ 1094us) write_op.cc:270] Start()
0429 19:54:50.266978 (+ 27us) write_op.cc:276] Timestamp: P: 1777492487380883 usec, L: 0
0429 19:54:50.267147 (+ 169us) write_op.cc:270] Start()
0429 19:54:50.267170 (+ 23us) write_op.cc:276] Timestamp: P: 1777492487401682 usec, L: 0
0429 19:54:50.268740 (+ 1570us) write_op.cc:270] Start()
0429 19:54:50.268760 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487418529 usec, L: 0
0429 19:54:50.268962 (+ 202us) write_op.cc:270] Start()
0429 19:54:50.268985 (+ 23us) write_op.cc:276] Timestamp: P: 1777492487425824 usec, L: 0
0429 19:54:50.269142 (+ 157us) write_op.cc:270] Start()
0429 19:54:50.269163 (+ 21us) write_op.cc:276] Timestamp: P: 1777492487491605 usec, L: 0
0429 19:54:50.269310 (+ 147us) write_op.cc:270] Start()
0429 19:54:50.269329 (+ 19us) write_op.cc:276] Timestamp: P: 1777492487509947 usec, L: 0
0429 19:54:50.269459 (+ 130us) write_op.cc:270] Start()
0429 19:54:50.269477 (+ 18us) write_op.cc:276] Timestamp: P: 1777492487515564 usec, L: 0
0429 19:54:50.269635 (+ 158us) write_op.cc:270] Start()
0429 19:54:50.269655 (+ 20us) write_op.cc:276] Timestamp: P: 1777492487525583 usec, L: 0
0429 19:54:50.269836 (+ 181us) write_op.cc:270] Start()
0429 19:54:50.269858 (+ 22us) write_op.cc:276] Timestamp: P: 1777492487563877 usec, L: 0
0429 19:54:50.270020 (+ 162us) write_op.cc:270] Start()
0429 19:54:50.270041 (+ 21us) write_op.cc:276] Timestamp: P: 1777492487581533 usec, L: 0
0429 19:54:50.313383 (+ 43342us) write_op.cc:270] Start()
0429 19:54:50.313407 (+ 24us) write_op.cc:276] Timestamp: P: 1777492487588305 usec, L: 0
0429 19:54:50.330016 (+ 16609us) write_op.cc:270] Start()
0429 19:54:50.330050 (+ 34us) write_op.cc:276] Timestamp: P: 1777492487591666 usec, L: 0
0429 19:54:50.330240 (+ 190us) write_op.cc:270] Start()
0429 19:54:50.330264 (+ 24us) write_op.cc:276] Timestamp: P: 1777492487640849 usec, L: 0
0429 19:54:50.349673 (+ 19409us) write_op.cc:270] Start()
0429 19:54:50.349703 (+ 30us) write_op.cc:276] Timestamp: P: 1777492487654284 usec, L: 0
0429 19:54:50.362891 (+ 13188us) write_op.cc:270] Start()
0429 19:54:50.362914 (+ 23us) write_op.cc:276] Timestamp: P: 1777492487664107 usec, L: 0
0429 19:54:50.368823 (+ 5909us) write_op.cc:270] Start()
0429 19:54:50.368855 (+ 32us) write_op.cc:276] Timestamp: P: 1777492487671785 usec, L: 0
0429 19:54:50.369018 (+ 163us) write_op.cc:270] Start()
0429 19:54:50.369040 (+ 22us) write_op.cc:276] Timestamp: P: 1777492487700992 usec, L: 0
0429 19:54:50.369175 (+ 135us) write_op.cc:270] Start()
0429 19:54:50.369194 (+ 19us) write_op.cc:276] Timestamp: P: 1777492487726095 usec, L: 0
0429 19:54:50.369365 (+ 171us) write_op.cc:270] Start()
0429 19:54:50.369386 (+ 21us) write_op.cc:276] Timestamp: P: 1777492487734218 usec, L: 0
0429 19:54:50.376209 (+ 6823us) write_op.cc:270] Start()
0429 19:54:50.376241 (+ 32us) write_op.cc:276] Timestamp: P: 1777492487738947 usec, L: 0
0429 19:54:50.376459 (+ 218us) write_op.cc:270] Start()
0429 19:54:50.376482 (+ 23us) write_op.cc:276] Timestamp: P: 1777492487763232 usec, L: 0
0429 19:54:50.376671 (+ 189us) write_op.cc:270] Start()
0429 19:54:50.376688 (+ 17us) write_op.cc:276] Timestamp: P: 1777492487795648 usec, L: 0
0429 19:54:50.378413 (+ 1725us) write_op.cc:270] Start()
0429 19:54:50.378440 (+ 27us) write_op.cc:276] Timestamp: P: 1777492487801017 usec, L: 0
0429 19:54:50.378606 (+ 166us) write_op.cc:270] Start()
0429 19:54:50.378625 (+ 19us) write_op.cc:276] Timestamp: P: 1777492487826868 usec, L: 0
0429 19:54:50.381252 (+ 2627us) write_op.cc:270] Start()
0429 19:54:50.381283 (+ 31us) write_op.cc:276] Timestamp: P: 1777492487881361 usec, L: 0
0429 19:54:50.381475 (+ 192us) write_op.cc:270] Start()
0429 19:54:50.381498 (+ 23us) write_op.cc:276] Timestamp: P: 1777492487903480 usec, L: 0
0429 19:54:50.386868 (+ 5370us) write_op.cc:270] Start()
0429 19:54:50.386898 (+ 30us) write_op.cc:276] Timestamp: P: 1777492487904123 usec, L: 0
0429 19:54:50.387138 (+ 240us) write_op.cc:270] Start()
0429 19:54:50.387159 (+ 21us) write_op.cc:276] Timestamp: P: 1777492487915861 usec, L: 0
0429 19:54:50.387325 (+ 166us) write_op.cc:270] Start()
0429 19:54:50.387346 (+ 21us) write_op.cc:276] Timestamp: P: 1777492487947703 usec, L: 0
0429 19:54:50.387480 (+ 134us) write_op.cc:270] Start()
0429 19:54:50.387499 (+ 19us) write_op.cc:276] Timestamp: P: 1777492488002956 usec, L: 0
0429 19:54:50.391052 (+ 3553us) write_op.cc:270] Start()
0429 19:54:50.391080 (+ 28us) write_op.cc:276] Timestamp: P: 1777492488017144 usec, L: 0
0429 19:54:50.402194 (+ 11114us) write_op.cc:270] Start()
0429 19:54:50.402227 (+ 33us) write_op.cc:276] Timestamp: P: 1777492488018989 usec, L: 0
0429 19:54:50.427669 (+ 25442us) write_op.cc:270] Start()
0429 19:54:50.427776 (+ 107us) write_op.cc:276] Timestamp: P: 1777492488037101 usec, L: 0
0429 19:54:50.428027 (+ 251us) write_op.cc:270] Start()
0429 19:54:50.428050 (+ 23us) write_op.cc:276] Timestamp: P: 1777492488055406 usec, L: 0
0429 19:54:50.446567 (+ 18517us) write_op.cc:270] Start()
0429 19:54:50.446593 (+ 26us) write_op.cc:276] Timestamp: P: 1777492488078359 usec, L: 0
0429 19:54:50.454248 (+ 7655us) write_op.cc:270] Start()
0429 19:54:50.454276 (+ 28us) write_op.cc:276] Timestamp: P: 1777492488092241 usec, L: 0
0429 19:54:50.465074 (+ 10798us) write_op.cc:270] Start()
0429 19:54:50.465109 (+ 35us) write_op.cc:276] Timestamp: P: 1777492488115005 usec, L: 0
0429 19:54:50.478589 (+ 13480us) write_op.cc:270] Start()
0429 19:54:50.478615 (+ 26us) write_op.cc:276] Timestamp: P: 1777492488127532 usec, L: 0
0429 19:54:50.483372 (+ 4757us) write_op.cc:270] Start()
0429 19:54:50.483406 (+ 34us) write_op.cc:276] Timestamp: P: 1777492488134988 usec, L: 0
0429 19:54:50.501430 (+ 18024us) write_op.cc:270] Start()
0429 19:54:50.501458 (+ 28us) write_op.cc:276] Timestamp: P: 1777492488136163 usec, L: 0
0429 19:54:50.501665 (+ 207us) write_op.cc:270] Start()
0429 19:54:50.501689 (+ 24us) write_op.cc:276] Timestamp: P: 1777492488181362 usec, L: 0
0429 19:54:50.501859 (+ 170us) write_op.cc:270] Start()
0429 19:54:50.501880 (+ 21us) write_op.cc:276] Timestamp: P: 1777492488209636 usec, L: 0
0429 19:54:50.502077 (+ 197us) write_op.cc:270] Start()
0429 19:54:50.502100 (+ 23us) write_op.cc:276] Timestamp: P: 1777492488219818 usec, L: 0
0429 19:54:50.502253 (+ 153us) write_op.cc:270] Start()
0429 19:54:50.502279 (+ 26us) write_op.cc:276] Timestamp: P: 1777492488225781 usec, L: 0
0429 19:54:50.502447 (+ 168us) write_op.cc:270] Start()
0429 19:54:50.502467 (+ 20us) write_op.cc:276] Timestamp: P: 1777492488236935 usec, L: 0
0429 19:54:50.516748 (+ 14281us) write_op.cc:270] Start()
0429 19:54:50.516776 (+ 28us) write_op.cc:276] Timestamp: P: 1777492488273864 usec, L: 0
0429 19:54:50.516957 (+ 181us) write_op.cc:270] Start()
0429 19:54:50.516980 (+ 23us) write_op.cc:276] Timestamp: P: 1777492488277156 usec, L: 0
0429 19:54:50.534055 (+ 17075us) write_op.cc:270] Start()
0429 19:54:50.534084 (+ 29us) write_op.cc:276] Timestamp: P: 1777492488323418 usec, L: 0
0429 19:54:50.539621 (+ 5537us) write_op.cc:270] Start()
0429 19:54:50.539641 (+ 20us) write_op.cc:276] Timestamp: P: 1777492488324196 usec, L: 0
0429 19:54:50.539771 (+ 130us) write_op.cc:270] Start()
0429 19:54:50.539789 (+ 18us) write_op.cc:276] Timestamp: P: 1777492488332440 usec, L: 0
0429 19:54:50.552453 (+ 12664us) write_op.cc:270] Start()
0429 19:54:50.552482 (+ 29us) write_op.cc:276] Timestamp: P: 1777492488334161 usec, L: 0
0429 19:54:50.558636 (+ 6154us) write_op.cc:270] Start()
0429 19:54:50.558666 (+ 30us) write_op.cc:276] Timestamp: P: 1777492488397209 usec, L: 0
0429 19:54:50.558856 (+ 190us) write_op.cc:270] Start()
0429 19:54:50.558877 (+ 21us) write_op.cc:276] Timestamp: P: 1777492488430405 usec, L: 0
0429 19:54:50.560687 (+ 1810us) write_op.cc:270] Start()
0429 19:54:50.560707 (+ 20us) write_op.cc:276] Timestamp: P: 1777492488432552 usec, L: 0
0429 19:54:50.583691 (+ 22984us) write_op.cc:270] Start()
0429 19:54:50.583721 (+ 30us) write_op.cc:276] Timestamp: P: 17774924
I20260429 19:54:52.643146 11446 raft_consensus.cc:493] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:52.643379 11446 raft_consensus.cc:515] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:52.662209 11446 leader_election.cc:290] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:52.662047 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1116 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:52.673719 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de046e6b43a7413fa6e9a65e426f4721" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1116 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:52.690193 11276 leader_election.cc:304] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:52.903268 11446 raft_consensus.cc:2749] T de046e6b43a7413fa6e9a65e426f4721 P b874a660f9d74e30bd258ed4e690aea1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260429 19:54:53.035228 11457 raft_consensus.cc:493] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:53.035472 11457 raft_consensus.cc:515] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:53.069708 10810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1134 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:53.070526 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841352e6f584a97a0f2801c9d8651a7" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1134 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:53.095047 11276 leader_election.cc:304] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:53.090606 11457 leader_election.cc:290] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:53.095646 11457 raft_consensus.cc:2749] T f841352e6f584a97a0f2801c9d8651a7 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 19:54:53.821884 11282 tablet_bootstrap.cc:492] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1: Bootstrap replayed 1/1 log segments. Stats: ops{read=150 overwritten=0 applied=146 ignored=0} inserts{seen=1237 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 4 replicates
I20260429 19:54:53.868508 11282 tablet_bootstrap.cc:492] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1: Bootstrap complete.
I20260429 19:54:53.904209 11282 ts_tablet_manager.cc:1403] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1: Time spent bootstrapping tablet: real 4.878s user 0.286s sys 0.054s
I20260429 19:54:53.932968 11282 raft_consensus.cc:359] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Replica starting. Triggering 4 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:54.017704 11282 raft_consensus.cc:740] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b874a660f9d74e30bd258ed4e690aea1, State: Initialized, Role: FOLLOWER
I20260429 19:54:54.039386 11282 consensus_queue.cc:260] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 146, Last appended: 1.150, Last appended by leader: 150, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:54.076635 11282 ts_tablet_manager.cc:1434] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1: Time spent starting tablet: real 0.172s user 0.005s sys 0.013s
I20260429 19:54:54.555051 11443 raft_consensus.cc:493] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:54.555351 11443 raft_consensus.cc:515] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:54.556368 11443 leader_election.cc:290] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:54.557950 10809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3449d2f7451d4a758233c5a1372a2960" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 986 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:54.558339 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3449d2f7451d4a758233c5a1372a2960" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 986 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:54.559764 11276 leader_election.cc:304] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:54.560719 11305 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:59566 (request call id 49) took 5050 ms. Trace:
I20260429 19:54:54.560834 11305 rpcz_store.cc:276] 0429 19:54:49.510426 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 19:54:49.510824 (+ 398us) service_pool.cc:225] Handling call
0429 19:54:54.556832 (+5046008us) spinlock_profiling.cc:243] Waited 4.99 s on lock 0x61600001a254. stack: 00007faa35dc9086 00007faa35dc8e40 00007faa34d823ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007faa41cb78c0 00007faa45b72eaf 00007faa3ff8ac36 00007faa3ff8a965 00007faa3cd9a65e 00007faa3cd9953e 00007faa3cd9f738 00007faa3cda009f 00007faa3cd9fec8 0000000000aa4cac
0429 19:54:54.560458 (+ 3626us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x616000019054. stack: 00007faa35dc9086 00007faa35dc8e40 00007faa34d823ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007faa41cb78c0 00007faa45b72eaf 00007faa3ff8ac36 00007faa3ff8a965 00007faa3cd9a65e 00007faa3cd9953e 00007faa3cd9f738 00007faa3cda009f 00007faa3cd9fec8 0000000000aa4cac
0429 19:54:54.560656 (+ 198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11493727360}
I20260429 19:54:54.561549 11443 raft_consensus.cc:2749] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 19:54:54.562117 11347 raft_consensus.cc:3060] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Advancing to term 3
I20260429 19:54:54.564216 11349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.32.66:59965 (request call id 20) took 5541 ms. Trace:
I20260429 19:54:54.566766 11347 pending_rounds.cc:85] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1: Aborting all ops after (but not including) 149
I20260429 19:54:54.566960 11347 pending_rounds.cc:107] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1: Aborting uncommitted WRITE_OP operation due to leader change: 1.150
I20260429 19:54:54.564401 11349 rpcz_store.cc:276] 0429 19:54:49.022265 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 19:54:49.024382 (+ 2117us) service_pool.cc:225] Handling call
0429 19:54:49.387575 (+363193us) raft_consensus.cc:1471] Updating replica for 838 ops
0429 19:54:50.043683 (+656108us) raft_consensus.cc:1534] Early marking committed up to index 149
0429 19:54:50.043814 (+ 131us) raft_consensus.cc:1539] Triggering prepare for 837 ops
0429 19:54:50.092592 (+ 48778us) write_op.cc:270] Start()
0429 19:54:50.092626 (+ 34us) write_op.cc:276] Timestamp: P: 1777492472159456 usec, L: 0
0429 19:54:50.171299 (+ 78673us) write_op.cc:270] Start()
0429 19:54:50.171335 (+ 36us) write_op.cc:276] Timestamp: P: 1777492472362132 usec, L: 0
0429 19:54:50.171530 (+ 195us) write_op.cc:270] Start()
0429 19:54:50.171550 (+ 20us) write_op.cc:276] Timestamp: P: 1777492472372674 usec, L: 0
0429 19:54:50.171715 (+ 165us) write_op.cc:270] Start()
0429 19:54:50.171735 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473038900 usec, L: 0
0429 19:54:50.174983 (+ 3248us) write_op.cc:270] Start()
0429 19:54:50.175017 (+ 34us) write_op.cc:276] Timestamp: P: 1777492473045537 usec, L: 0
0429 19:54:50.175199 (+ 182us) write_op.cc:270] Start()
0429 19:54:50.175223 (+ 24us) write_op.cc:276] Timestamp: P: 1777492473075048 usec, L: 0
0429 19:54:50.175360 (+ 137us) write_op.cc:270] Start()
0429 19:54:50.175416 (+ 56us) write_op.cc:276] Timestamp: P: 1777492473075643 usec, L: 0
0429 19:54:50.175564 (+ 148us) write_op.cc:270] Start()
0429 19:54:50.175581 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473078508 usec, L: 0
0429 19:54:50.176332 (+ 751us) write_op.cc:270] Start()
0429 19:54:50.176366 (+ 34us) write_op.cc:276] Timestamp: P: 1777492473107865 usec, L: 0
0429 19:54:50.176561 (+ 195us) write_op.cc:270] Start()
0429 19:54:50.176580 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473132422 usec, L: 0
0429 19:54:50.200482 (+ 23902us) write_op.cc:270] Start()
0429 19:54:50.200514 (+ 32us) write_op.cc:276] Timestamp: P: 1777492473161237 usec, L: 0
0429 19:54:50.200720 (+ 206us) write_op.cc:270] Start()
0429 19:54:50.200740 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473163992 usec, L: 0
0429 19:54:50.208832 (+ 8092us) write_op.cc:270] Start()
0429 19:54:50.208858 (+ 26us) write_op.cc:276] Timestamp: P: 1777492473166908 usec, L: 0
0429 19:54:50.225737 (+ 16879us) write_op.cc:270] Start()
0429 19:54:50.225763 (+ 26us) write_op.cc:276] Timestamp: P: 1777492473178926 usec, L: 0
0429 19:54:50.241314 (+ 15551us) write_op.cc:270] Start()
0429 19:54:50.241342 (+ 28us) write_op.cc:276] Timestamp: P: 1777492473204887 usec, L: 0
0429 19:54:50.241542 (+ 200us) write_op.cc:270] Start()
0429 19:54:50.241575 (+ 33us) write_op.cc:276] Timestamp: P: 1777492473211296 usec, L: 0
0429 19:54:50.241773 (+ 198us) write_op.cc:270] Start()
0429 19:54:50.241795 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473219574 usec, L: 0
0429 19:54:50.241938 (+ 143us) write_op.cc:270] Start()
0429 19:54:50.241956 (+ 18us) write_op.cc:276] Timestamp: P: 1777492473224203 usec, L: 0
0429 19:54:50.243683 (+ 1727us) write_op.cc:270] Start()
0429 19:54:50.349061 (+105378us) write_op.cc:276] Timestamp: P: 1777492473266162 usec, L: 0
0429 19:54:50.356237 (+ 7176us) write_op.cc:270] Start()
0429 19:54:50.356276 (+ 39us) write_op.cc:276] Timestamp: P: 1777492473268079 usec, L: 0
0429 19:54:50.364239 (+ 7963us) write_op.cc:270] Start()
0429 19:54:50.364261 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473272684 usec, L: 0
0429 19:54:50.364390 (+ 129us) write_op.cc:270] Start()
0429 19:54:50.364406 (+ 16us) write_op.cc:276] Timestamp: P: 1777492473301389 usec, L: 0
0429 19:54:50.387527 (+ 23121us) write_op.cc:270] Start()
0429 19:54:50.387548 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473325289 usec, L: 0
0429 19:54:50.387690 (+ 142us) write_op.cc:270] Start()
0429 19:54:50.387709 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473327524 usec, L: 0
0429 19:54:50.404210 (+ 16501us) write_op.cc:270] Start()
0429 19:54:50.404242 (+ 32us) write_op.cc:276] Timestamp: P: 1777492473352062 usec, L: 0
0429 19:54:50.431316 (+ 27074us) write_op.cc:270] Start()
0429 19:54:50.431347 (+ 31us) write_op.cc:276] Timestamp: P: 1777492473365314 usec, L: 0
0429 19:54:50.431535 (+ 188us) write_op.cc:270] Start()
0429 19:54:50.431558 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473383137 usec, L: 0
0429 19:54:50.431718 (+ 160us) write_op.cc:270] Start()
0429 19:54:50.431740 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473402769 usec, L: 0
0429 19:54:50.431890 (+ 150us) write_op.cc:270] Start()
0429 19:54:50.431910 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473424001 usec, L: 0
0429 19:54:50.432073 (+ 163us) write_op.cc:270] Start()
0429 19:54:50.432093 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473437942 usec, L: 0
0429 19:54:50.432254 (+ 161us) write_op.cc:270] Start()
0429 19:54:50.432273 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473461248 usec, L: 0
0429 19:54:50.444483 (+ 12210us) write_op.cc:270] Start()
0429 19:54:50.444517 (+ 34us) write_op.cc:276] Timestamp: P: 1777492473466525 usec, L: 0
0429 19:54:50.476455 (+ 31938us) write_op.cc:270] Start()
0429 19:54:50.476486 (+ 31us) write_op.cc:276] Timestamp: P: 1777492473479115 usec, L: 0
0429 19:54:50.478846 (+ 2360us) write_op.cc:270] Start()
0429 19:54:50.478867 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473480757 usec, L: 0
0429 19:54:50.499387 (+ 20520us) write_op.cc:270] Start()
0429 19:54:50.499418 (+ 31us) write_op.cc:276] Timestamp: P: 1777492473509714 usec, L: 0
0429 19:54:50.508211 (+ 8793us) write_op.cc:270] Start()
0429 19:54:50.524115 (+ 15904us) write_op.cc:276] Timestamp: P: 1777492473512849 usec, L: 0
0429 19:54:50.535515 (+ 11400us) write_op.cc:270] Start()
0429 19:54:50.535542 (+ 27us) write_op.cc:276] Timestamp: P: 1777492473519747 usec, L: 0
0429 19:54:50.535706 (+ 164us) write_op.cc:270] Start()
0429 19:54:50.535729 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473528085 usec, L: 0
0429 19:54:50.539412 (+ 3683us) write_op.cc:270] Start()
0429 19:54:50.539441 (+ 29us) write_op.cc:276] Timestamp: P: 1777492473553349 usec, L: 0
0429 19:54:50.540303 (+ 862us) write_op.cc:270] Start()
0429 19:54:50.540329 (+ 26us) write_op.cc:276] Timestamp: P: 1777492473559676 usec, L: 0
0429 19:54:50.544484 (+ 4155us) write_op.cc:270] Start()
0429 19:54:50.544509 (+ 25us) write_op.cc:276] Timestamp: P: 1777492473581429 usec, L: 0
0429 19:54:50.560478 (+ 15969us) write_op.cc:270] Start()
0429 19:54:50.560508 (+ 30us) write_op.cc:276] Timestamp: P: 1777492473596802 usec, L: 0
0429 19:54:50.560678 (+ 170us) write_op.cc:270] Start()
0429 19:54:50.560699 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473599538 usec, L: 0
0429 19:54:50.568052 (+ 7353us) write_op.cc:270] Start()
0429 19:54:50.568091 (+ 39us) write_op.cc:276] Timestamp: P: 1777492473611342 usec, L: 0
0429 19:54:50.572587 (+ 4496us) write_op.cc:270] Start()
0429 19:54:50.572623 (+ 36us) write_op.cc:276] Timestamp: P: 1777492473634579 usec, L: 0
0429 19:54:50.600239 (+ 27616us) write_op.cc:270] Start()
0429 19:54:50.600263 (+ 24us) write_op.cc:276] Timestamp: P: 1777492473655213 usec, L: 0
0429 19:54:50.603977 (+ 3714us) write_op.cc:270] Start()
0429 19:54:50.604012 (+ 35us) write_op.cc:276] Timestamp: P: 1777492473659820 usec, L: 0
0429 19:54:50.625696 (+ 21684us) write_op.cc:270] Start()
0429 19:54:50.625728 (+ 32us) write_op.cc:276] Timestamp: P: 1777492473661088 usec, L: 0
0429 19:54:50.625912 (+ 184us) write_op.cc:270] Start()
0429 19:54:50.625947 (+ 35us) write_op.cc:276] Timestamp: P: 1777492473695280 usec, L: 0
0429 19:54:50.631381 (+ 5434us) write_op.cc:270] Start()
0429 19:54:50.631409 (+ 28us) write_op.cc:276] Timestamp: P: 1777492473700752 usec, L: 0
0429 19:54:50.641728 (+ 10319us) write_op.cc:270] Start()
0429 19:54:50.641758 (+ 30us) write_op.cc:276] Timestamp: P: 1777492473727293 usec, L: 0
0429 19:54:50.641975 (+ 217us) write_op.cc:270] Start()
0429 19:54:50.641997 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473728331 usec, L: 0
0429 19:54:50.642162 (+ 165us) write_op.cc:270] Start()
0429 19:54:50.642182 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473750182 usec, L: 0
0429 19:54:50.642336 (+ 154us) write_op.cc:270] Start()
0429 19:54:50.642357 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473757817 usec, L: 0
0429 19:54:50.642532 (+ 175us) write_op.cc:270] Start()
0429 19:54:50.642551 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473774203 usec, L: 0
0429 19:54:50.642725 (+ 174us) write_op.cc:270] Start()
0429 19:54:50.642750 (+ 25us) write_op.cc:276] Timestamp: P: 1777492473790862 usec, L: 0
0429 19:54:50.642926 (+ 176us) write_op.cc:270] Start()
0429 19:54:50.642947 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473795559 usec, L: 0
0429 19:54:50.643085 (+ 138us) write_op.cc:270] Start()
0429 19:54:50.643104 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473822058 usec, L: 0
0429 19:54:50.643242 (+ 138us) write_op.cc:270] Start()
0429 19:54:50.643262 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473841394 usec, L: 0
0429 19:54:50.643410 (+ 148us) write_op.cc:270] Start()
0429 19:54:50.643471 (+ 61us) write_op.cc:276] Timestamp: P: 1777492473843749 usec, L: 0
0429 19:54:50.643613 (+ 142us) write_op.cc:270] Start()
0429 19:54:50.643633 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473861057 usec, L: 0
0429 19:54:50.643797 (+ 164us) write_op.cc:270] Start()
0429 19:54:50.643818 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473886346 usec, L: 0
0429 19:54:50.643975 (+ 157us) write_op.cc:270] Start()
0429 19:54:50.643995 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473894794 usec, L: 0
0429 19:54:50.644152 (+ 157us) write_op.cc:270] Start()
0429 19:54:50.644170 (+ 18us) write_op.cc:276] Timestamp: P: 1777492473897766 usec, L: 0
0429 19:54:50.667321 (+ 23151us) write_op.cc:270] Start()
0429 19:54:50.667352 (+ 31us) write_op.cc:276] Timestamp: P: 1777492473928524 usec, L: 0
0429 19:54:50.667587 (+ 235us) write_op.cc:270] Start()
0429 19:54:50.667611 (+ 24us) write_op.cc:276] Timestamp: P: 1777492473934966 usec, L: 0
0429 19:54:50.667788 (+ 177us) write_op.cc:270] Start()
0429 19:54:50.667809 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473940271 usec, L: 0
0429 19:54:50.667959 (+ 150us) write_op.cc:270] Start()
0429 19:54:50.667979 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473988597 usec, L: 0
0429 19:54:50.668117 (+ 138us) write_op.cc:270] Start()
0429 19:54:50.668136 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473989458 usec, L: 0
0429 19:54:50.668286 (+ 150us) write_op.cc:270] Start()
0429 19:54:50.668305 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473992012 usec, L: 0
0429 19:54:50.668440 (+ 135us) write_op.cc:270] Start()
0429 19:54:50.668460 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473995440 usec, L: 0
0429 19:54:50.668608 (+ 148us) write_op.cc:270] Start()
0429 19:54:50.668627 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474034293 usec, L: 0
0429 19:54:50.688356 (+ 19729us) write_op.cc:270] Start()
0429 19:54:50.688380 (+ 24us) write_op.cc:276] Timestamp: P: 1777492474037155 usec, L: 0
0429 19:54:50.692372 (+ 3992us) write_op.cc:270] Start()
0429 19:54:50.692401 (+ 29us) write_op.cc:276] Timestamp: P: 1777492474054766 usec, L: 0
0429 19:54:50.692567 (+ 166us) write_op.cc:270] Start()
0429 19:54:50.692589 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474076563 usec, L: 0
0429 19:54:50.692738 (+ 149us) write_op.cc:270] Start()
0429 19:54:50.692758 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474083560 usec, L: 0
0429 19:54:50.728546 (+ 35788us) write_op.cc:270] Start()
0429 19:54:50.728582 (+ 36us) write_op.cc:276] Timestamp: P: 1777492474101957 usec, L: 0
0429 19:54:50.730172 (+ 1590us) write_op.cc:270] Start()
0429 19:54:50.744005 (+ 13833us) write_op.cc:276] Timestamp: P: 1777492474111207 usec, L: 0
0429 19:54:50.762019 (+ 18014us) write_op.cc:270] Start()
0429 19:54:50.762047 (+ 28us) write_op.cc:276] Timestamp: P: 1777492474152076 usec, L: 0
0429 19:54:50.762241 (+ 194us) write_op.cc:270] Start()
0429 19:54:50.762268 (+ 27us) write_op.cc:276] Timestamp: P: 1777492474166217 usec, L: 0
0429 19:54:50.762457 (+ 189us) write_op.cc:270] Start()
0429 19:54:50.762478 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474178425 usec, L: 0
0429 19:54:50.782511 (+ 20033us) write_op.cc:270] Start()
0429 19:54:50.782542 (+ 31us) write_op.cc:276] Timestamp: P: 1777492474184593 usec, L: 0
0429 19:54:50.797995 (+ 15453us) write_op.cc:270] Start()
0429 19:54:50.798016 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474232075 usec, L: 0
0429 19:54:50.799631 (+ 1615us) write_op.cc:270] Start()
0429 19:54:50.799650 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474236769 usec, L: 0
0429 19:54:50.812950 (+ 13300us) write_op.cc:270] Start()
0429 19:54:50.812984 (+ 34us) write_op.cc:276] Timestamp: P: 1777492474252935 usec, L: 0
0429 19:54:50.823972 (+ 10988us) write_op.cc:270] Start()
0429 19:54:50.823994 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474253602 usec, L: 0
0429 19:54:50.824159 (+ 165us) write_op.cc:270] Start()
0429 19:54:50.824180 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474289647 usec, L: 0
0429 19:54:50.825740 (+ 1560us) write_op.cc:270] Start()
0429 19:54:50.825783 (+ 43us) write_op.cc:276] Timestamp: P: 1777492474299362 usec, L: 0
0429 19:54:50.825942 (+ 159us) write_op.cc:270] Start()
0429 19:54:50.825960 (+ 18us) write_op.cc:276] Timestamp: P: 1777492474330057 usec, L: 0
0429 19:54:50.826136 (+ 176us) write_op.cc:270] Start()
0429 19:54:50.826155 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474355024 usec, L: 0
0429 19:54:50.826299 (+ 144us) write_op.cc:270] Start()
0429 19:54:50.826318 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474360892 usec, L: 0
0429 19:54:50.826471 (+ 153us) write_op.cc:270] Start()
0429 19:54:50.826490 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474374268 usec, L: 0
0429 19:54:50.826637 (+ 147us) write_op.cc:270] Start()
0429 19:54:50.826657 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474409168 usec, L: 0
0429 19:54:50.826799 (+ 142us) write_op.cc:270] Start()
0429 19:54:50.826819 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474413219 usec, L: 0
0429 19:54:50.830009 (+ 3190us) write_op.cc:270] Start()
0429 19:54:50.830038 (+ 29us) write_op.cc:276] Timestamp: P: 1777492474431605 usec, L: 0
0429 19:54:50.840997 (+ 10959us) write_op.cc:270] Start()
0429 19:54:50.841028 (+ 31us) write_op.cc:276] Timestamp: P: 1777492474443540 usec, L: 0
0429 19:54:50.845568 (+ 4540us) write_op.cc:270] Start()
0429 19:54:50.845597 (+ 29us) write_op.cc:276] Timestamp: P: 1777492474460086 usec, L: 0
0429 19:54:50.845800 (+ 203us) write_op.cc:270] Start()
0429 19:54:50.845822 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474476135 usec, L: 0
0429 19:54:50.880158 (+ 34336us) write_op.cc:270] Start()
0429 19:54:50.880193 (+ 35us) write_op.cc:276] Timestamp: P: 1777492474489339 usec, L: 0
0429 19:54:50.881768 (+ 1575us) write_op.cc:270] Start()
0429 19:54:50.881800 (+ 32us) write_op.cc:276] Timestamp: P: 1777492474510154 usec, L: 0
0429 19:54:50.889551 (+ 7751us) write_op.cc:270] Start()
0429 19:54:50.889598 (+ 47us) write_op.cc:276] Timestamp: P: 1777492474545777 usec, L: 0
0429 19:54:50.942292 (+ 52694us) write_op.cc:270] Start()
0429 19:54:50.942332 (+ 40us) write_op.cc:276] Timestamp: P: 1777492474554168 usec, L: 0
0429 19:54:50.942799 (+ 467us) write_op.cc:270] Start()
0429 19:54:50.942824 (+ 25us) write_op.cc:276] Timestamp: P: 1777492474559568 usec, L: 0
0429 19:54:50.943015 (+ 191us) write_op.cc:270] Start()
0429 19:54:50.943037 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474572525 usec, L: 0
0429 19:54:50.943188 (+ 151us) write_op.cc:270] Start()
0429 19:54:50.943209 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474586898 usec, L: 0
0429 19:54:50.943346 (+ 137us) write_op.cc:270] Start()
0429 19:54:50.943365 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474610997 usec, L: 0
0429 19:54:50.943501 (+ 136us) write_op.cc:270] Start()
0429 19:54:50.943521 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474632129 usec, L: 0
0429 19:54:50.943718 (+ 197us) write_op.cc:270] Start()
0429 19:54:50.943739 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474636259 usec, L: 0
0429 19:54:50.943939 (+ 200us) write_op.cc:270] Start()
0429 19:54:50.943961 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474648043 usec, L: 0
0429 19:54:50.944128 (+ 167us) write_op.cc:270] Start()
0429 19:54:50.944150 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474678815 usec, L: 0
0429 19:54:50.944279 (+ 129us) write_op.cc:270] Start()
0429 19:54:50.944298 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474702687 usec, L: 0
0429 19:54:50.944451 (+ 153us) write_op.cc:270] Start()
0429 19:54:50.944479 (+ 28us) write_op.cc:276] Timestamp: P: 1777492474704262 usec, L: 0
0429 19:54:50.944639 (+ 160us) write_op.cc:270] Start()
0429 19:54:50.944658 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474713367 usec, L: 0
0429 19:54:50.944801 (+ 143us) write_op.cc:270] Start()
0429 19:54:50.944819 (+ 18us) write_op.cc:276] Timestamp: P: 1777492474726095 usec, L: 0
0429 19:54:50.944989 (+ 170us) write_op.cc:270] Start()
0429 19:54:50.945011 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474750774 usec, L: 0
0429 19:54:50.945161 (+ 150us) write_op.cc:270] Start()
0429 19:54:50.945180 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474761488 usec, L: 0
0429 19:54:50.945332 (+ 152us) write_op.cc:270] Start()
0429 19:54:50.945352 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474772792 usec, L: 0
0429 19:54:50.945501 (+ 149us) write_op.cc:270] Start()
0429 19:54:50.945520 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474776674 usec, L: 0
0429 19:54:50.945679 (+ 159us) write_op.cc:270] Start()
0429 19:54:50.945700 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474806681 usec, L: 0
0429 19:54:50.945873 (+ 173us) write_op.cc:270] Start()
0429 19:54:50.945893 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474821656 usec, L: 0
0429 19:54:50.946065 (+ 172us) write_op.cc:270] Start()
0429 19:54:50.946085 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474831913 usec, L: 0
0429 19:54:50.946217 (+ 132us) write_op.cc:270] Start()
0429 19:54:50.946237 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474858107 usec, L: 0
0429 19:54:50.948784 (+ 2547us) write_op.cc:270] Start()
0429 19:54:50.948821 (+ 37us) write_op.cc:276] Timestamp: P: 1777492474867308 usec, L: 0
0429 19:54:50.958607 (+ 9786us) write_op.cc:270] Start()
0429 19:54:50.958634 (+ 27us) write_op.cc:276] Timestamp: P: 1777492474871235 usec, L: 0
0429 19:54:50.964493 (+ 5859us) write_op.cc:270] Start()
0429 19:54:50.964529 (+ 36us) write_op.cc:276] Timestamp: P: 1777492474874836 usec, L: 0
0429 19:54:50.970484 (+ 5955us) write_op.cc:270] Start()
0429 19:54:50.970516 (+ 32us) write_op.cc:276] Timestamp: P: 1777492474924187 usec, L: 0
0429 19:54:50.970753 (+ 237us) write_op.cc:270] Start()
0429 19:54:50.970777 (+ 24us) write_op.cc:276] Timestamp: P: 1777492474946521 usec, L: 0
0429 19:54:51.000074 (+ 29297us) write_op.cc:270] Start()
0429 19:54:51.000104 (+ 30us) write_op.cc:276] Timestamp: P: 1777492474949687 usec, L: 0
0429 19:54:51.023657 (+ 23553us) write_op.cc:270] Start()
0429 19:54:51.023692 (+ 35us) write_op.cc:276] Timestamp: P: 1777492474950370 usec, L: 0
0429 19:54:51.028049 (+ 4357us) write_op.cc:270] Start()
0429 19:54:51.028078 (+ 29us) write_op.cc:276] Timestamp: P: 1777492474978537 usec, L: 0
0429 19:54:51.048549 (+ 20471us) write_op.cc:270] Start()
0429 19:54:51.051583 (+ 3034us) write_op.cc:276] Timestamp: P: 1777492475006646 usec, L: 0
0429 19:54:51.055288 (+ 3705us) write_op.cc:270] Start()
0429 19:54:51.055324 (+ 36us) write_op.cc:276] Timestamp: P: 1777492475010319 usec, L: 0
0429 19:54:51.078239 (+ 22915us) write_op.cc:270] Start()
0429 19:54:51.078275 (+ 36us) write_op.cc:276] Timestamp: P: 1777492475013280 usec, L: 0
0429 19:54:51.078502 (+ 227us) write_op.cc:270] Start()
0429 19:54:51.078526 (+ 24us) write_op.cc:276] Timestamp: P: 1777492475021270 usec, L: 0
0429 19:54:51.078671 (+ 145us) write_op.cc:270] Start()
0429 19:54:51.078690 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475047949 usec, L: 0
0429 19:54:51.078839 (+ 149us) write_op.cc:270] Start()
0429 19:54:51.078863 (+ 24us) write_op.cc:276] Timestamp: P: 1777492475067236 usec, L: 0
0429 19:54:51.079011 (+ 148us) write_op.cc:270] Start()
0429 19:54:51.079030 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475072925 usec, L: 0
0429 19:54:51.079176 (+ 146us) write_op.cc:270] Start()
0429 19:54:51.079195 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475085520 usec, L: 0
0429 19:54:51.096426 (+ 17231us) write_op.cc:270] Start()
0429 19:54:51.096456 (+ 30us) write_op.cc:276] Timestamp: P: 1777492475112480 usec, L: 0
0429 19:54:51.100005 (+ 3549us) write_op.cc:270] Start()
0429 19:54:51.100033 (+ 28us) write_op.cc:276] Timestamp: P: 1777492475129973 usec, L: 0
0429 19:54:51.102546 (+ 2513us) write_op.cc:270] Start()
0429 19:54:51.102572 (+ 26us) write_op.cc:276] Timestamp: P: 1777492475140485 usec, L: 0
0429 19:54:51.109378 (+ 6806us) write_op.cc:270] Start()
0429 19:54:51.109413 (+ 35us) write_op.cc:276] Timestamp: P: 1777492475146543 usec, L: 0
0429 19:54:51.109634 (+ 221us) write_op.cc:270] Start()
0429 19:54:51.109656 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475165238 usec, L: 0
0429 19:54:51.109801 (+ 145us) write_op.cc:270] Start()
0429 19:54:51.109822 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475175202 usec, L: 0
0429 19:54:51.109974 (+ 152us) write_op.cc:270] Start()
0429 19:54:51.109993 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475207347 usec, L: 0
0429 19:54:51.111234 (+ 1241us) write_op.cc:270] Start()
0429 19:54:51.111260 (+ 26us) write_op.cc:276] Timestamp: P: 1777492475223601 usec, L: 0
0429 19:54:51.140560 (+ 29300us) write_op.cc:270] Start()
0429 19:54:51.140590 (+ 30us) write_op.cc:276] Timestamp: P: 1777492475224233 usec, L: 0
0429 19:54:51.144428 (+ 3838us) write_op.cc:270] Start()
0429 19:54:51.144456 (+ 28us) write_op.cc:276] Timestamp: P: 1777492475226232 usec, L: 0
0429 19:54:51.148531 (+ 4075us) write_op.cc:270] Start()
0429 19:54:51.148562 (+ 31us) write_op.cc:276] Timestamp: P: 1777492475252193 usec, L: 0
0429 19:54:51.175988 (+ 27426us) write_op.cc:270] Start()
0429 19:54:51.176026 (+ 38us) write_op.cc:276] Timestamp: P: 1777492475264381 usec, L: 0
0429 19:54:51.176234 (+ 208us) write_op.cc:270] Start()
0429 19:54:51.176256 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475274901 usec, L: 0
0429 19:54:51.181086 (+ 4830us) write_op.cc:270] Start()
0429 19:54:51.181109 (+ 23us) write_op.cc:276] Timestamp: P: 1777492475283500 usec, L: 0
0429 19:54:51.183206 (+ 2097us) write_op.cc:270] Start()
0429 19:54:51.183235 (+ 29us) write_op.cc:276] Timestamp: P: 1777492475306275 usec, L: 0
0429 19:54:51.183408 (+ 173us) write_op.cc:270] Start()
0429 19:54:51.183429 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475328849 usec, L: 0
0429 19:54:51.183590 (+ 161us) write_op.cc:270] Start()
0429 19:54:51.183610 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475332516 usec, L: 0
0429 19:54:51.183750 (+ 140us) write_op.cc:270] Start()
0429 19:54:51.183769 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475334786 usec, L: 0
0429 19:54:51.183909 (+ 140us) write_op.cc:270] Start()
0429 19:54:51.183928 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475375004 usec, L: 0
0429 19:54:51.184079 (+ 151us) write_op.cc:270] Start()
0429 19:54:51.184098 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475407086 usec, L: 0
0429 19:54:51.184736 (+ 638us) write_op.cc:270] Start()
0429 19:54:51.184761 (+ 25us) write_op.cc:276] Timestamp: P: 1777492475421357 usec, L: 0
0429 19:54:51.184951 (+ 190us) write_op.cc:270] Start()
0429 19:54:51.184973 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475432387 usec, L: 0
0429 19:54:51.185128 (+ 155us) write_op.cc:270] Start()
0429 19:54:51.185147 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475439828 usec, L: 0
0429 19:54:51.185299 (+ 152us) write_op.cc:270] Start()
0429 19:54:51.185320 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475465001 usec, L: 0
0429 19:54:51.185494 (+ 174us) write_op.cc:270] Start()
0429 19:54:51.185513 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475495823 usec, L: 0
0429 19:54:51.185632 (+ 119us) write_op.cc:270] Start()
0429 19:54:51.185648 (+ 16us) write_op.cc:276] Timestamp: P: 1777492475509317 usec, L: 0
0429 19:54:51.185759 (+ 111us) write_op.cc:270] Start()
0429 19:54:51.185776 (+ 17us) write_op.cc:276] Timestamp: P: 1777492475514578 usec, L: 0
0429 19:54:51.185892 (+ 116us) write_op.cc:270] Start()
0429 19:54:51.201545 (+ 15653us) write_op.cc:276] Timestamp: P: 1777492475520827 usec, L: 0
0429 19:54:51.204358 (+ 2813us) write_op.cc:270] Start()
0429 19:54:51.204413 (+ 55us) write_op.cc:276] Timestamp: P: 1777492475540153 usec, L: 0
0429 19:54:51.208410 (+ 3997us) write_op.cc:270] Start()
0429 19:54:51.208436 (+ 26us) write_op.cc:276] Timestamp: P: 1777492475582897 usec, L: 0
0429 19:54:51.210878 (+ 2442us) write_op.cc:270] Start()
0429 19:54:51.210906 (+ 28us) write_op.cc:276] Timestamp: P: 1777492475586743 usec, L: 0
0429 19:54:51.211084 (+ 178us) write_op.cc:270] Start()
0429 19:54:51.211105 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475587356 usec, L: 0
0429 19:54:51.214775 (+ 3670us) write_op.cc:270] Start()
0429 19:54:51.214804 (+ 29us) write_op.cc:276] Timestamp: P: 1777492475591549 usec, L: 0
0429 19:54:51.214978 (+ 174us) write_op.cc:270] Start()
0429 19:54:51.214999 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475633943 usec, L: 0
0429 19:54:51.215163 (+ 164us) write_op.cc:270] Start()
0429 19:54:51.215184 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475650618 usec, L: 0
0429 19:54:51.215339 (+ 155us) write_op.cc:270] Start()
0429 19:54:51.215415 (+ 76us) write_op.cc:276] Timestamp: P: 1777492475655159 usec, L: 0
0429 19:54:51.215563 (+ 148us) write_op.cc:270] Start()
0429 19:54:51.215584 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475669081 usec, L: 0
0429 19:54:51.216073 (+ 489us) write_op.cc:270] Start()
0429 19:54:51.216096 (+ 23us) write_op.cc:276] Timestamp: P: 1777492475697525 usec, L: 0
0429 19:54:51.216235 (+ 139us) write_op.cc:270] Start()
0429 19:54:51.216252 (+ 17us) write_op.cc:276] Timestamp: P: 1777492475711267 usec, L: 0
0429 19:54:51.216382 (+ 130us) write_op.cc:270] Start()
0429 19:54:51.216400 (+ 18us) write_op.cc:276] Timestamp: P: 1777492475749423 usec, L: 0
0429 19:54:51.234570 (+ 18170us) write_op.cc:270] Start()
0429 19:54:51.234608 (+ 38us) write_op.cc:276] Timestamp: P: 1777492475752191 usec, L: 0
0429 19:54:51.240360 (+ 5752us) write_op.cc:270] Start()
0429 19:54:51.240397 (+ 37us) write_op.cc:276] Timestamp: P: 1777492475762717 usec, L: 0
0429 19:54:51.246440 (+ 6043us) write_op.cc:270] Start()
0429 19:54:51.246476 (+ 36us) write_op.cc:276] Timestamp: P: 1777492475772649 usec, L: 0
0429 19:54:51.251474 (+ 4998us) write_op.cc:270] Start()
0429 19:54:51.251505 (+ 31us) write_op.cc:276] Timestamp: P: 1777492475808477 usec, L: 0
0429 19:54:51.279803 (+ 28298us) write_op.cc:270] Start()
0429 19:54:51.279839 (+ 36us) write_op.cc:276] Timestamp: P: 1777492475810632 usec, L: 0
0429 19:54:51.283959 (+ 4120us) write_op.cc:270] Start()
0429 19:54:51.283995 (+ 36us) write_op.cc:276] Timestamp: P: 1777492475846610 usec, L: 0
0429 19:54:51.295353 (+ 11358us) write_op.cc:270] Start()
0429 19:54:51.295389 (+ 36us) write_op.cc:276] Timestamp: P: 1777492475855821 usec, L: 0
0429 19:54:51.295587 (+ 198us) write_op.cc:270] Start()
0429 19:54:51.295606 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475868111 usec, L: 0
0429 19:54:51.295744 (+ 138us) write_op.cc:270] Start()
0429 19:54:51.295773 (+ 29us) write_op.cc:276] Timestamp: P: 1777492475874981 usec, L: 0
0429 19:54:51.295900 (+ 127us) write_op.cc:270] Start()
0429 19:54:51.295917 (+ 17us) write_op.cc:276] Timestamp: P: 1777492475923145 usec, L: 0
0429 19:54:51.296040 (+ 123us) write_op.cc:270] Start()
0429 19:54:51.296058 (+ 18us) write_op.cc:276] Timestamp: P: 1777492475945011 usec, L: 0
0429 19:54:51.296182 (+ 124us) write_op.cc:270] Start()
0429 19:54:51.296200 (+ 18us) write_op.cc:276] Timestamp: P: 1777492475957314 usec, L: 0
0429 19:54:51.302930 (+ 6730us) write_op.cc:270] Start()
0429 19:54:51.302962 (+ 32us) write_op.cc:276] Timestamp: P: 1777492475960603 usec, L: 0
0429 19:54:51.306284 (+ 3322us) write_op.cc:270] Start()
0429 19:54:51.306312 (+ 28us) write_op.cc:276] Timestamp: P: 1777492475967303 usec, L: 0
0429 19:54:51.309141 (+ 2829us) write_op.cc:270] Start()
0429 19:54:51.309172 (+ 31us) write_op.cc:276] Timestamp: P: 1777492476000337 usec, L: 0
0429 19:54:51.313548 (+ 4376us) write_op.cc:270] Start()
0429 19:54:51.313577 (+ 29us) write_op.cc:276] Timestamp: P: 1777492476029951 usec, L: 0
0429 19:54:51.314973 (+ 1396us) write_op.cc:270] Start()
0429 19:54:51.314998 (+ 25us) write_op.cc:276] Timestamp: P: 1777492476033670 usec, L: 0
0429 19:54:51.315176 (+ 178us) write_op.cc:270] Start()
0429 19:54:51.315199 (+ 23us) write_op.cc:276] Timestamp: P: 1777492476035024 usec, L: 0
0429 19:54:51.315340 (+ 141us) write_op.cc:270] Start()
0429 19:54:51.315360 (+ 20us) write_op.cc:276] Timestamp: P: 177749
I20260429 19:54:55.449940 11443 raft_consensus.cc:493] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:54:55.450152 11443 raft_consensus.cc:515] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:55.452152 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3449d2f7451d4a758233c5a1372a2960" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1257 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:55.452369 10810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3449d2f7451d4a758233c5a1372a2960" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1257 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:55.453832 11443 leader_election.cc:290] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:55.455092 11276 leader_election.cc:304] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:55.455994 11443 raft_consensus.cc:2749] T 3449d2f7451d4a758233c5a1372a2960 P b874a660f9d74e30bd258ed4e690aea1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260429 19:54:57.401782 11473 log.cc:927] Time spent T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1: Append to log took a long time: real 0.095s user 0.002s sys 0.000s
I20260429 19:54:57.589224 11463 raft_consensus.cc:493] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b091bf2bbc547978432dfe2dbc1ffcd)
I20260429 19:54:57.589378 11463 raft_consensus.cc:515] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:57.589509 11305 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:59566 (request call id 55) took 1676 ms. Trace:
I20260429 19:54:57.589596 11305 rpcz_store.cc:276] 0429 19:54:55.912935 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 19:54:55.912989 (+ 54us) service_pool.cc:225] Handling call
0429 19:54:57.588822 (+1675833us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x61600001a854. stack: 00007faa35dc9086 00007faa35dc8e40 00007faa34d823ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007faa41cb78c0 00007faa45b72eaf 00007faa3ff8ac36 00007faa3ff8a965 00007faa3cd9a65e 00007faa3cd9953e 00007faa3cd9f738 00007faa3cda009f 00007faa3cd9fec8 0000000000aa4cac
0429 19:54:57.589485 (+ 663us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3852791680}
I20260429 19:54:57.590065 11463 leader_election.cc:290] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:57.590351 11347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.32.67:35721 (request call id 69) took 3932 ms. Trace:
I20260429 19:54:57.591579 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d4a1fea40d4f60866e5c4e8d75c743" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 4 candidate_status { last_received { term: 3 index: 1203 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:57.611860 10680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d4a1fea40d4f60866e5c4e8d75c743" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 4 candidate_status { last_received { term: 3 index: 1203 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:57.651671 11276 leader_election.cc:304] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:57.652143 11463 raft_consensus.cc:2749] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260429 19:54:57.590838 11347 rpcz_store.cc:276] 0429 19:54:53.657922 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 19:54:53.658909 (+ 987us) service_pool.cc:225] Handling call
0429 19:54:54.316611 (+657702us) raft_consensus.cc:1471] Updating replica for 1054 ops
0429 19:54:54.579616 (+263005us) write_op.cc:489] Releasing partition, row and schema locks
0429 19:54:54.579620 (+ 4us) write_op.cc:454] Released schema lock
0429 19:54:54.581265 (+ 1645us) raft_consensus.cc:1534] Early marking committed up to index 149
0429 19:54:54.581516 (+ 251us) raft_consensus.cc:1539] Triggering prepare for 1054 ops
0429 19:54:54.581727 (+ 211us) write_op.cc:270] Start()
0429 19:54:54.581755 (+ 28us) write_op.cc:276] Timestamp: P: 1777492473018671 usec, L: 0
0429 19:54:54.581959 (+ 204us) write_op.cc:270] Start()
0429 19:54:54.581979 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473032589 usec, L: 0
0429 19:54:54.582451 (+ 472us) write_op.cc:270] Start()
0429 19:54:54.582476 (+ 25us) write_op.cc:276] Timestamp: P: 1777492473041710 usec, L: 0
0429 19:54:54.582671 (+ 195us) write_op.cc:270] Start()
0429 19:54:54.582697 (+ 26us) write_op.cc:276] Timestamp: P: 1777492473044297 usec, L: 0
0429 19:54:54.582885 (+ 188us) write_op.cc:270] Start()
0429 19:54:54.582903 (+ 18us) write_op.cc:276] Timestamp: P: 1777492473053503 usec, L: 0
0429 19:54:54.584286 (+ 1383us) write_op.cc:270] Start()
0429 19:54:54.584344 (+ 58us) write_op.cc:276] Timestamp: P: 1777492473061564 usec, L: 0
0429 19:54:54.584539 (+ 195us) write_op.cc:270] Start()
0429 19:54:54.584560 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473063151 usec, L: 0
0429 19:54:54.585572 (+ 1012us) write_op.cc:270] Start()
0429 19:54:54.585595 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473072413 usec, L: 0
0429 19:54:54.586222 (+ 627us) write_op.cc:270] Start()
0429 19:54:54.586246 (+ 24us) write_op.cc:276] Timestamp: P: 1777492473096166 usec, L: 0
0429 19:54:54.587570 (+ 1324us) write_op.cc:270] Start()
0429 19:54:54.587593 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473124268 usec, L: 0
0429 19:54:54.588949 (+ 1356us) write_op.cc:270] Start()
0429 19:54:54.588973 (+ 24us) write_op.cc:276] Timestamp: P: 1777492473146056 usec, L: 0
0429 19:54:54.590800 (+ 1827us) write_op.cc:270] Start()
0429 19:54:54.590827 (+ 27us) write_op.cc:276] Timestamp: P: 1777492473154142 usec, L: 0
0429 19:54:54.591023 (+ 196us) write_op.cc:270] Start()
0429 19:54:54.591045 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473158488 usec, L: 0
0429 19:54:54.610327 (+ 19282us) write_op.cc:270] Start()
0429 19:54:54.616252 (+ 5925us) write_op.cc:276] Timestamp: P: 1777492473177832 usec, L: 0
0429 19:54:54.619873 (+ 3621us) write_op.cc:270] Start()
0429 19:54:54.619904 (+ 31us) write_op.cc:276] Timestamp: P: 1777492473197127 usec, L: 0
0429 19:54:54.620108 (+ 204us) write_op.cc:270] Start()
0429 19:54:54.620129 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473202794 usec, L: 0
0429 19:54:54.622741 (+ 2612us) write_op.cc:270] Start()
0429 19:54:54.622770 (+ 29us) write_op.cc:276] Timestamp: P: 1777492473212052 usec, L: 0
0429 19:54:54.622951 (+ 181us) write_op.cc:270] Start()
0429 19:54:54.622973 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473226028 usec, L: 0
0429 19:54:54.624850 (+ 1877us) write_op.cc:270] Start()
0429 19:54:54.624879 (+ 29us) write_op.cc:276] Timestamp: P: 1777492473253654 usec, L: 0
0429 19:54:54.625089 (+ 210us) write_op.cc:270] Start()
0429 19:54:54.625112 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473258579 usec, L: 0
0429 19:54:54.634674 (+ 9562us) write_op.cc:270] Start()
0429 19:54:54.634703 (+ 29us) write_op.cc:276] Timestamp: P: 1777492473259794 usec, L: 0
0429 19:54:54.635754 (+ 1051us) write_op.cc:270] Start()
0429 19:54:54.635804 (+ 50us) write_op.cc:276] Timestamp: P: 1777492473296767 usec, L: 0
0429 19:54:54.635997 (+ 193us) write_op.cc:270] Start()
0429 19:54:54.636044 (+ 47us) write_op.cc:276] Timestamp: P: 1777492473311105 usec, L: 0
0429 19:54:54.638217 (+ 2173us) write_op.cc:270] Start()
0429 19:54:54.638243 (+ 26us) write_op.cc:276] Timestamp: P: 1777492473323890 usec, L: 0
0429 19:54:54.638460 (+ 217us) write_op.cc:270] Start()
0429 19:54:54.638484 (+ 24us) write_op.cc:276] Timestamp: P: 1777492473333281 usec, L: 0
0429 19:54:54.638657 (+ 173us) write_op.cc:270] Start()
0429 19:54:54.638680 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473353164 usec, L: 0
0429 19:54:54.638911 (+ 231us) write_op.cc:270] Start()
0429 19:54:54.638946 (+ 35us) write_op.cc:276] Timestamp: P: 1777492473368490 usec, L: 0
0429 19:54:54.639113 (+ 167us) write_op.cc:270] Start()
0429 19:54:54.639133 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473398261 usec, L: 0
0429 19:54:54.642587 (+ 3454us) write_op.cc:270] Start()
0429 19:54:54.642615 (+ 28us) write_op.cc:276] Timestamp: P: 1777492473420454 usec, L: 0
0429 19:54:54.643496 (+ 881us) write_op.cc:270] Start()
0429 19:54:54.643519 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473431965 usec, L: 0
0429 19:54:54.644183 (+ 664us) write_op.cc:270] Start()
0429 19:54:54.644218 (+ 35us) write_op.cc:276] Timestamp: P: 1777492473459822 usec, L: 0
0429 19:54:54.644882 (+ 664us) write_op.cc:270] Start()
0429 19:54:54.644909 (+ 27us) write_op.cc:276] Timestamp: P: 1777492473460659 usec, L: 0
0429 19:54:54.645604 (+ 695us) write_op.cc:270] Start()
0429 19:54:54.645627 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473476186 usec, L: 0
0429 19:54:54.646907 (+ 1280us) write_op.cc:270] Start()
0429 19:54:54.646945 (+ 38us) write_op.cc:276] Timestamp: P: 1777492473477402 usec, L: 0
0429 19:54:54.670060 (+ 23115us) write_op.cc:270] Start()
0429 19:54:54.670086 (+ 26us) write_op.cc:276] Timestamp: P: 1777492473513575 usec, L: 0
0429 19:54:54.670271 (+ 185us) write_op.cc:270] Start()
0429 19:54:54.670294 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473522330 usec, L: 0
0429 19:54:54.670497 (+ 203us) write_op.cc:270] Start()
0429 19:54:54.670516 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473523090 usec, L: 0
0429 19:54:54.670728 (+ 212us) write_op.cc:270] Start()
0429 19:54:54.670748 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473523813 usec, L: 0
0429 19:54:54.670887 (+ 139us) write_op.cc:270] Start()
0429 19:54:54.670916 (+ 29us) write_op.cc:276] Timestamp: P: 1777492473558068 usec, L: 0
0429 19:54:54.671092 (+ 176us) write_op.cc:270] Start()
0429 19:54:54.671109 (+ 17us) write_op.cc:276] Timestamp: P: 1777492473558804 usec, L: 0
0429 19:54:54.671265 (+ 156us) write_op.cc:270] Start()
0429 19:54:54.671285 (+ 20us) write_op.cc:276] Timestamp: P: 1777492473577427 usec, L: 0
0429 19:54:54.671565 (+ 280us) write_op.cc:270] Start()
0429 19:54:54.671588 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473587214 usec, L: 0
0429 19:54:54.671766 (+ 178us) write_op.cc:270] Start()
0429 19:54:54.671795 (+ 29us) write_op.cc:276] Timestamp: P: 1777492473593565 usec, L: 0
0429 19:54:54.672000 (+ 205us) write_op.cc:270] Start()
0429 19:54:54.672021 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473611987 usec, L: 0
0429 19:54:54.672183 (+ 162us) write_op.cc:270] Start()
0429 19:54:54.672202 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473627288 usec, L: 0
0429 19:54:54.672377 (+ 175us) write_op.cc:270] Start()
0429 19:54:54.672395 (+ 18us) write_op.cc:276] Timestamp: P: 1777492473648184 usec, L: 0
0429 19:54:54.672564 (+ 169us) write_op.cc:270] Start()
0429 19:54:54.672583 (+ 19us) write_op.cc:276] Timestamp: P: 1777492473653942 usec, L: 0
0429 19:54:54.673191 (+ 608us) write_op.cc:270] Start()
0429 19:54:54.673218 (+ 27us) write_op.cc:276] Timestamp: P: 1777492473668065 usec, L: 0
0429 19:54:54.673535 (+ 317us) write_op.cc:270] Start()
0429 19:54:54.673562 (+ 27us) write_op.cc:276] Timestamp: P: 1777492473693936 usec, L: 0
0429 19:54:54.676818 (+ 3256us) write_op.cc:270] Start()
0429 19:54:54.676850 (+ 32us) write_op.cc:276] Timestamp: P: 1777492473703203 usec, L: 0
0429 19:54:54.677548 (+ 698us) write_op.cc:270] Start()
0429 19:54:54.677575 (+ 27us) write_op.cc:276] Timestamp: P: 1777492473719429 usec, L: 0
0429 19:54:54.677946 (+ 371us) write_op.cc:270] Start()
0429 19:54:54.677969 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473724552 usec, L: 0
0429 19:54:54.678146 (+ 177us) write_op.cc:270] Start()
0429 19:54:54.678167 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473744239 usec, L: 0
0429 19:54:54.678372 (+ 205us) write_op.cc:270] Start()
0429 19:54:54.678431 (+ 59us) write_op.cc:276] Timestamp: P: 1777492473762644 usec, L: 0
0429 19:54:54.678635 (+ 204us) write_op.cc:270] Start()
0429 19:54:54.678660 (+ 25us) write_op.cc:276] Timestamp: P: 1777492473770388 usec, L: 0
0429 19:54:54.679006 (+ 346us) write_op.cc:270] Start()
0429 19:54:54.679106 (+ 100us) write_op.cc:276] Timestamp: P: 1777492473787272 usec, L: 0
0429 19:54:54.679491 (+ 385us) write_op.cc:270] Start()
0429 19:54:54.679519 (+ 28us) write_op.cc:276] Timestamp: P: 1777492473787850 usec, L: 0
0429 19:54:54.679751 (+ 232us) write_op.cc:270] Start()
0429 19:54:54.679776 (+ 25us) write_op.cc:276] Timestamp: P: 1777492473816026 usec, L: 0
0429 19:54:54.681569 (+ 1793us) write_op.cc:270] Start()
0429 19:54:54.681596 (+ 27us) write_op.cc:276] Timestamp: P: 1777492473821073 usec, L: 0
0429 19:54:54.683326 (+ 1730us) write_op.cc:270] Start()
0429 19:54:54.683354 (+ 28us) write_op.cc:276] Timestamp: P: 1777492473831494 usec, L: 0
0429 19:54:54.683547 (+ 193us) write_op.cc:270] Start()
0429 19:54:54.683569 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473856475 usec, L: 0
0429 19:54:54.684962 (+ 1393us) write_op.cc:270] Start()
0429 19:54:54.684989 (+ 27us) write_op.cc:276] Timestamp: P: 1777492473890174 usec, L: 0
0429 19:54:54.685985 (+ 996us) write_op.cc:270] Start()
0429 19:54:54.686010 (+ 25us) write_op.cc:276] Timestamp: P: 1777492473894850 usec, L: 0
0429 19:54:54.686189 (+ 179us) write_op.cc:270] Start()
0429 19:54:54.686214 (+ 25us) write_op.cc:276] Timestamp: P: 1777492473910080 usec, L: 0
0429 19:54:54.687593 (+ 1379us) write_op.cc:270] Start()
0429 19:54:54.687633 (+ 40us) write_op.cc:276] Timestamp: P: 1777492473925995 usec, L: 0
0429 19:54:54.687822 (+ 189us) write_op.cc:270] Start()
0429 19:54:54.687844 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473939478 usec, L: 0
0429 19:54:54.688661 (+ 817us) write_op.cc:270] Start()
0429 19:54:54.688684 (+ 23us) write_op.cc:276] Timestamp: P: 1777492473947744 usec, L: 0
0429 19:54:54.688901 (+ 217us) write_op.cc:270] Start()
0429 19:54:54.688923 (+ 22us) write_op.cc:276] Timestamp: P: 1777492473974485 usec, L: 0
0429 19:54:54.689084 (+ 161us) write_op.cc:270] Start()
0429 19:54:54.689105 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473979917 usec, L: 0
0429 19:54:54.689350 (+ 245us) write_op.cc:270] Start()
0429 19:54:54.689371 (+ 21us) write_op.cc:276] Timestamp: P: 1777492473994000 usec, L: 0
0429 19:54:54.689887 (+ 516us) write_op.cc:270] Start()
0429 19:54:54.689912 (+ 25us) write_op.cc:276] Timestamp: P: 1777492474015266 usec, L: 0
0429 19:54:54.690095 (+ 183us) write_op.cc:270] Start()
0429 19:54:54.690116 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474029853 usec, L: 0
0429 19:54:54.690361 (+ 245us) write_op.cc:270] Start()
0429 19:54:54.690405 (+ 44us) write_op.cc:276] Timestamp: P: 1777492474035046 usec, L: 0
0429 19:54:54.690635 (+ 230us) write_op.cc:270] Start()
0429 19:54:54.690656 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474051706 usec, L: 0
0429 19:54:54.690843 (+ 187us) write_op.cc:270] Start()
0429 19:54:54.690864 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474071503 usec, L: 0
0429 19:54:54.691401 (+ 537us) write_op.cc:270] Start()
0429 19:54:54.691444 (+ 43us) write_op.cc:276] Timestamp: P: 1777492474085315 usec, L: 0
0429 19:54:54.691660 (+ 216us) write_op.cc:270] Start()
0429 19:54:54.691684 (+ 24us) write_op.cc:276] Timestamp: P: 1777492474104178 usec, L: 0
0429 19:54:54.691871 (+ 187us) write_op.cc:270] Start()
0429 19:54:54.691893 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474116226 usec, L: 0
0429 19:54:54.692075 (+ 182us) write_op.cc:270] Start()
0429 19:54:54.692096 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474139494 usec, L: 0
0429 19:54:54.692283 (+ 187us) write_op.cc:270] Start()
0429 19:54:54.692304 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474141994 usec, L: 0
0429 19:54:54.692518 (+ 214us) write_op.cc:270] Start()
0429 19:54:54.692539 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474172434 usec, L: 0
0429 19:54:54.693031 (+ 492us) write_op.cc:270] Start()
0429 19:54:54.693052 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474179722 usec, L: 0
0429 19:54:54.693238 (+ 186us) write_op.cc:270] Start()
0429 19:54:54.693260 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474227956 usec, L: 0
0429 19:54:54.693453 (+ 193us) write_op.cc:270] Start()
0429 19:54:54.693486 (+ 33us) write_op.cc:276] Timestamp: P: 1777492474229233 usec, L: 0
0429 19:54:54.693687 (+ 201us) write_op.cc:270] Start()
0429 19:54:54.693708 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474244736 usec, L: 0
0429 19:54:54.694009 (+ 301us) write_op.cc:270] Start()
0429 19:54:54.694029 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474245375 usec, L: 0
0429 19:54:54.694229 (+ 200us) write_op.cc:270] Start()
0429 19:54:54.694252 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474291140 usec, L: 0
0429 19:54:54.694485 (+ 233us) write_op.cc:270] Start()
0429 19:54:54.694507 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474303840 usec, L: 0
0429 19:54:54.694753 (+ 246us) write_op.cc:270] Start()
0429 19:54:54.694773 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474321180 usec, L: 0
0429 19:54:54.694951 (+ 178us) write_op.cc:270] Start()
0429 19:54:54.694971 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474326912 usec, L: 0
0429 19:54:54.695156 (+ 185us) write_op.cc:270] Start()
0429 19:54:54.695175 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474350460 usec, L: 0
0429 19:54:54.695344 (+ 169us) write_op.cc:270] Start()
0429 19:54:54.695363 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474370073 usec, L: 0
0429 19:54:54.695536 (+ 173us) write_op.cc:270] Start()
0429 19:54:54.695555 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474394611 usec, L: 0
0429 19:54:54.695758 (+ 203us) write_op.cc:270] Start()
0429 19:54:54.695804 (+ 46us) write_op.cc:276] Timestamp: P: 1777492474408214 usec, L: 0
0429 19:54:54.696000 (+ 196us) write_op.cc:270] Start()
0429 19:54:54.696020 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474417046 usec, L: 0
0429 19:54:54.696181 (+ 161us) write_op.cc:270] Start()
0429 19:54:54.696199 (+ 18us) write_op.cc:276] Timestamp: P: 1777492474437064 usec, L: 0
0429 19:54:54.696379 (+ 180us) write_op.cc:270] Start()
0429 19:54:54.696399 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474459917 usec, L: 0
0429 19:54:54.696681 (+ 282us) write_op.cc:270] Start()
0429 19:54:54.696700 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474477644 usec, L: 0
0429 19:54:54.696868 (+ 168us) write_op.cc:270] Start()
0429 19:54:54.696887 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474485129 usec, L: 0
0429 19:54:54.697074 (+ 187us) write_op.cc:270] Start()
0429 19:54:54.697094 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474508171 usec, L: 0
0429 19:54:54.699022 (+ 1928us) write_op.cc:270] Start()
0429 19:54:54.699046 (+ 24us) write_op.cc:276] Timestamp: P: 1777492474541731 usec, L: 0
0429 19:54:54.699279 (+ 233us) write_op.cc:270] Start()
0429 19:54:54.699301 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474556827 usec, L: 0
0429 19:54:54.699510 (+ 209us) write_op.cc:270] Start()
0429 19:54:54.699532 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474558762 usec, L: 0
0429 19:54:54.699707 (+ 175us) write_op.cc:270] Start()
0429 19:54:54.699732 (+ 25us) write_op.cc:276] Timestamp: P: 1777492474580221 usec, L: 0
0429 19:54:54.699924 (+ 192us) write_op.cc:270] Start()
0429 19:54:54.699945 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474585860 usec, L: 0
0429 19:54:54.700173 (+ 228us) write_op.cc:270] Start()
0429 19:54:54.700193 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474613838 usec, L: 0
0429 19:54:54.700410 (+ 217us) write_op.cc:270] Start()
0429 19:54:54.700431 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474639348 usec, L: 0
0429 19:54:54.700616 (+ 185us) write_op.cc:270] Start()
0429 19:54:54.700635 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474640690 usec, L: 0
0429 19:54:54.700791 (+ 156us) write_op.cc:270] Start()
0429 19:54:54.700811 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474647678 usec, L: 0
0429 19:54:54.701499 (+ 688us) write_op.cc:270] Start()
0429 19:54:54.701523 (+ 24us) write_op.cc:276] Timestamp: P: 1777492474682654 usec, L: 0
0429 19:54:54.701752 (+ 229us) write_op.cc:270] Start()
0429 19:54:54.701794 (+ 42us) write_op.cc:276] Timestamp: P: 1777492474693703 usec, L: 0
0429 19:54:54.701983 (+ 189us) write_op.cc:270] Start()
0429 19:54:54.702001 (+ 18us) write_op.cc:276] Timestamp: P: 1777492474694654 usec, L: 0
0429 19:54:54.702191 (+ 190us) write_op.cc:270] Start()
0429 19:54:54.702211 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474701714 usec, L: 0
0429 19:54:54.717185 (+ 14974us) write_op.cc:270] Start()
0429 19:54:54.717209 (+ 24us) write_op.cc:276] Timestamp: P: 1777492474730978 usec, L: 0
0429 19:54:54.717388 (+ 179us) write_op.cc:270] Start()
0429 19:54:54.717407 (+ 19us) write_op.cc:276] Timestamp: P: 1777492474749376 usec, L: 0
0429 19:54:54.717538 (+ 131us) write_op.cc:270] Start()
0429 19:54:54.717554 (+ 16us) write_op.cc:276] Timestamp: P: 1777492474758589 usec, L: 0
0429 19:54:54.717714 (+ 160us) write_op.cc:270] Start()
0429 19:54:54.717731 (+ 17us) write_op.cc:276] Timestamp: P: 1777492474771403 usec, L: 0
0429 19:54:54.717922 (+ 191us) write_op.cc:270] Start()
0429 19:54:54.717940 (+ 18us) write_op.cc:276] Timestamp: P: 1777492474773507 usec, L: 0
0429 19:54:54.718060 (+ 120us) write_op.cc:270] Start()
0429 19:54:54.718075 (+ 15us) write_op.cc:276] Timestamp: P: 1777492474795922 usec, L: 0
0429 19:54:54.718289 (+ 214us) write_op.cc:270] Start()
0429 19:54:54.718305 (+ 16us) write_op.cc:276] Timestamp: P: 1777492474817763 usec, L: 0
0429 19:54:54.718466 (+ 161us) write_op.cc:270] Start()
0429 19:54:54.718484 (+ 18us) write_op.cc:276] Timestamp: P: 1777492474830381 usec, L: 0
0429 19:54:54.718614 (+ 130us) write_op.cc:270] Start()
0429 19:54:54.718632 (+ 18us) write_op.cc:276] Timestamp: P: 1777492474859455 usec, L: 0
0429 19:54:54.718800 (+ 168us) write_op.cc:270] Start()
0429 19:54:54.718823 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474869914 usec, L: 0
0429 19:54:54.718967 (+ 144us) write_op.cc:270] Start()
0429 19:54:54.718987 (+ 20us) write_op.cc:276] Timestamp: P: 1777492474871626 usec, L: 0
0429 19:54:54.719118 (+ 131us) write_op.cc:270] Start()
0429 19:54:54.719139 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474895880 usec, L: 0
0429 19:54:54.719353 (+ 214us) write_op.cc:270] Start()
0429 19:54:54.719375 (+ 22us) write_op.cc:276] Timestamp: P: 1777492474915414 usec, L: 0
0429 19:54:54.719569 (+ 194us) write_op.cc:270] Start()
0429 19:54:54.719592 (+ 23us) write_op.cc:276] Timestamp: P: 1777492474926641 usec, L: 0
0429 19:54:54.719745 (+ 153us) write_op.cc:270] Start()
0429 19:54:54.719770 (+ 25us) write_op.cc:276] Timestamp: P: 1777492474931225 usec, L: 0
0429 19:54:54.746022 (+ 26252us) write_op.cc:270] Start()
0429 19:54:54.746053 (+ 31us) write_op.cc:276] Timestamp: P: 1777492474934639 usec, L: 0
0429 19:54:54.746275 (+ 222us) write_op.cc:270] Start()
0429 19:54:54.746299 (+ 24us) write_op.cc:276] Timestamp: P: 1777492474974237 usec, L: 0
0429 19:54:54.746503 (+ 204us) write_op.cc:270] Start()
0429 19:54:54.746524 (+ 21us) write_op.cc:276] Timestamp: P: 1777492474994073 usec, L: 0
0429 19:54:54.746707 (+ 183us) write_op.cc:270] Start()
0429 19:54:54.746729 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475001019 usec, L: 0
0429 19:54:54.746882 (+ 153us) write_op.cc:270] Start()
0429 19:54:54.746903 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475002878 usec, L: 0
0429 19:54:54.747053 (+ 150us) write_op.cc:270] Start()
0429 19:54:54.747074 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475017103 usec, L: 0
0429 19:54:54.747220 (+ 146us) write_op.cc:270] Start()
0429 19:54:54.747240 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475041071 usec, L: 0
0429 19:54:54.747409 (+ 169us) write_op.cc:270] Start()
0429 19:54:54.747431 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475059534 usec, L: 0
0429 19:54:54.747623 (+ 192us) write_op.cc:270] Start()
0429 19:54:54.747644 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475069857 usec, L: 0
0429 19:54:54.747812 (+ 168us) write_op.cc:270] Start()
0429 19:54:54.747833 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475078023 usec, L: 0
0429 19:54:54.747996 (+ 163us) write_op.cc:270] Start()
0429 19:54:54.748014 (+ 18us) write_op.cc:276] Timestamp: P: 1777492475104505 usec, L: 0
0429 19:54:54.748199 (+ 185us) write_op.cc:270] Start()
0429 19:54:54.748220 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475105284 usec, L: 0
0429 19:54:54.748403 (+ 183us) write_op.cc:270] Start()
0429 19:54:54.748425 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475121020 usec, L: 0
0429 19:54:54.748592 (+ 167us) write_op.cc:270] Start()
0429 19:54:54.748612 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475136964 usec, L: 0
0429 19:54:54.748757 (+ 145us) write_op.cc:270] Start()
0429 19:54:54.748779 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475164113 usec, L: 0
0429 19:54:54.748973 (+ 194us) write_op.cc:270] Start()
0429 19:54:54.748994 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475167017 usec, L: 0
0429 19:54:54.749165 (+ 171us) write_op.cc:270] Start()
0429 19:54:54.749185 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475204647 usec, L: 0
0429 19:54:54.749352 (+ 167us) write_op.cc:270] Start()
0429 19:54:54.749382 (+ 30us) write_op.cc:276] Timestamp: P: 1777492475214023 usec, L: 0
0429 19:54:54.749566 (+ 184us) write_op.cc:270] Start()
0429 19:54:54.749587 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475216337 usec, L: 0
0429 19:54:54.749763 (+ 176us) write_op.cc:270] Start()
0429 19:54:54.749784 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475221552 usec, L: 0
0429 19:54:54.749961 (+ 177us) write_op.cc:270] Start()
0429 19:54:54.749981 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475240990 usec, L: 0
0429 19:54:54.750152 (+ 171us) write_op.cc:270] Start()
0429 19:54:54.750169 (+ 17us) write_op.cc:276] Timestamp: P: 1777492475254268 usec, L: 0
0429 19:54:54.751672 (+ 1503us) write_op.cc:270] Start()
0429 19:54:54.751696 (+ 24us) write_op.cc:276] Timestamp: P: 1777492475277254 usec, L: 0
0429 19:54:54.751844 (+ 148us) write_op.cc:270] Start()
0429 19:54:54.751861 (+ 17us) write_op.cc:276] Timestamp: P: 1777492475280328 usec, L: 0
0429 19:54:54.752049 (+ 188us) write_op.cc:270] Start()
0429 19:54:54.752070 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475314834 usec, L: 0
0429 19:54:54.752226 (+ 156us) write_op.cc:270] Start()
0429 19:54:54.752251 (+ 25us) write_op.cc:276] Timestamp: P: 1777492475317680 usec, L: 0
0429 19:54:54.752428 (+ 177us) write_op.cc:270] Start()
0429 19:54:54.752565 (+ 137us) write_op.cc:276] Timestamp: P: 1777492475320805 usec, L: 0
0429 19:54:54.752753 (+ 188us) write_op.cc:270] Start()
0429 19:54:54.752775 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475324259 usec, L: 0
0429 19:54:54.752938 (+ 163us) write_op.cc:270] Start()
0429 19:54:54.752959 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475378937 usec, L: 0
0429 19:54:54.753171 (+ 212us) write_op.cc:270] Start()
0429 19:54:54.753192 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475400034 usec, L: 0
0429 19:54:54.753419 (+ 227us) write_op.cc:270] Start()
0429 19:54:54.753440 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475407825 usec, L: 0
0429 19:54:54.753603 (+ 163us) write_op.cc:270] Start()
0429 19:54:54.753624 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475412308 usec, L: 0
0429 19:54:54.753775 (+ 151us) write_op.cc:270] Start()
0429 19:54:54.753794 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475439000 usec, L: 0
0429 19:54:54.753997 (+ 203us) write_op.cc:270] Start()
0429 19:54:54.754020 (+ 23us) write_op.cc:276] Timestamp: P: 1777492475463885 usec, L: 0
0429 19:54:54.754175 (+ 155us) write_op.cc:270] Start()
0429 19:54:54.754195 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475498499 usec, L: 0
0429 19:54:54.754328 (+ 133us) write_op.cc:270] Start()
0429 19:54:54.754423 (+ 95us) write_op.cc:276] Timestamp: P: 1777492475502384 usec, L: 0
0429 19:54:54.754605 (+ 182us) write_op.cc:270] Start()
0429 19:54:54.754652 (+ 47us) write_op.cc:276] Timestamp: P: 1777492475511281 usec, L: 0
0429 19:54:54.754828 (+ 176us) write_op.cc:270] Start()
0429 19:54:54.754848 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475514143 usec, L: 0
0429 19:54:54.754983 (+ 135us) write_op.cc:270] Start()
0429 19:54:54.754999 (+ 16us) write_op.cc:276] Timestamp: P: 1777492475542758 usec, L: 0
0429 19:54:54.755126 (+ 127us) write_op.cc:270] Start()
0429 19:54:54.755145 (+ 19us) write_op.cc:276] Timestamp: P: 1777492475578538 usec, L: 0
0429 19:54:54.755321 (+ 176us) write_op.cc:270] Start()
0429 19:54:54.755342 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475581479 usec, L: 0
0429 19:54:54.778978 (+ 23636us) write_op.cc:270] Start()
0429 19:54:54.779007 (+ 29us) write_op.cc:276] Timestamp: P: 1777492475582267 usec, L: 0
0429 19:54:54.779240 (+ 233us) write_op.cc:270] Start()
0429 19:54:54.779261 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475587615 usec, L: 0
0429 19:54:54.779466 (+ 205us) write_op.cc:270] Start()
0429 19:54:54.779487 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475627054 usec, L: 0
0429 19:54:54.780529 (+ 1042us) write_op.cc:270] Start()
0429 19:54:54.780552 (+ 23us) write_op.cc:276] Timestamp: P: 1777492475641907 usec, L: 0
0429 19:54:54.780757 (+ 205us) write_op.cc:270] Start()
0429 19:54:54.780778 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475646866 usec, L: 0
0429 19:54:54.780964 (+ 186us) write_op.cc:270] Start()
0429 19:54:54.781004 (+ 40us) write_op.cc:276] Timestamp: P: 1777492475653167 usec, L: 0
0429 19:54:54.781217 (+ 213us) write_op.cc:270] Start()
0429 19:54:54.781239 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475689523 usec, L: 0
0429 19:54:54.782374 (+ 1135us) write_op.cc:270] Start()
0429 19:54:54.782420 (+ 46us) write_op.cc:276] Timestamp: P: 1777492475706216 usec, L: 0
0429 19:54:54.782628 (+ 208us) write_op.cc:270] Start()
0429 19:54:54.782649 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475732993 usec, L: 0
0429 19:54:54.783803 (+ 1154us) write_op.cc:270] Start()
0429 19:54:54.783826 (+ 23us) write_op.cc:276] Timestamp: P: 1777492475734638 usec, L: 0
0429 19:54:54.784028 (+ 202us) write_op.cc:270] Start()
0429 19:54:54.784049 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475747850 usec, L: 0
0429 19:54:54.784223 (+ 174us) write_op.cc:270] Start()
0429 19:54:54.784244 (+ 21us) write_op.cc:276] Timestamp: P: 1777492475773207 usec, L: 0
0429 19:54:54.784504 (+ 260us) write_op.cc:270] Start()
0429 19:54:54.784527 (+ 23us) write_op.cc:276] Timestamp: P: 1777492475790685 usec, L: 0
0429 19:54:54.788551 (+ 4024us) write_op.cc:270] Start()
0429 19:54:54.788567 (+ 16us) write_op.cc:276] Timestamp: P: 1777492475799642 usec, L: 0
0429 19:54:54.789027 (+ 460us) write_op.cc:270] Start()
0429 19:54:54.789049 (+ 22us) write_op.cc:276] Timestamp: P: 1777492475833320 usec, L: 0
0429 19:54:54.789594 (+ 545us) write_op.cc:270] Start()
0429 19:54:54.789621 (+ 27us) write_op.cc:276] Timestamp: P: 1777492475843634 usec, L: 0
0429 19:54:54.789794 (+ 173us) write_op.cc:270] Start()
0429 19:54:54.789811 (+ 17us) write_op.cc:276] Timestamp: P: 1777492475867899 usec, L: 0
0429 19:54:54.789964 (+ 153us) write_op.cc:270] Start()
0429 19:54:54.789979 (+ 15us) write_op.cc:276] Timestamp: P: 1777492475872321 usec, L: 0
0429 19:54:54.790145 (+ 166us) write_op.cc:270] Start()
0429 19:54:54.790161 (+ 16us) write_op.cc:276] Timestamp: P: 1777492475920582 usec, L: 0
0429 19:54:54.790346 (+ 185us) write_op.cc:270] Start()
0429 19:54:54.790361 (+ 15us) write_op.cc:276] Timestamp: P: 1777492475940360 usec, L: 0
0429 19:54:54.790541 (+ 180us) write_op.cc:270] Start()
0429 19:54:54.790561 (+ 20us) write_op.cc:276] Timestamp: P: 1777492475960694 usec, L: 0
0429 19:54:54.834816 (+ 44255us) write_op.cc:270] Start()
0429 19:54:54.834842 (+ 26us) write_op.cc:276] Timestamp: P: 1777492475962272 usec, L: 0
0429 19:54:54.835776 (+ 934us) write_op.cc:270] Start()
0429 19:54:54.835799 (+ 23us) write_op.cc:276] Timestamp: P: 1777492475968134 usec, L: 0
0429 19:54:54.836243 (+ 444us) write_op.cc:270] Start()
0429 19:54:54.836264 (+ 21us) write_op.cc:276] Timestamp: P: 1777492476001343 usec, L: 0
0429 19:54:54.840815 (+ 4551us) write_op.cc:270] Start()
0429 19:54:54.840842 (+ 27us) write_op.cc:276] Timestamp: P: 1777492476017321 usec, L: 0
0429 19:54:54.841661 (+ 819us) write_op.cc:270] Start()
0429 19:54:54.841681 (+ 20us) write_op.cc:276] Timestamp: P: 1777492476022941 usec, L: 0
0429 19:54:54.862646 (+ 20965us) write_op.cc:270] Start()
0429 19:54:54.862674 (+ 28us) write_op.cc:276] Times
I20260429 19:54:58.012095 11463 raft_consensus.cc:493] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b091bf2bbc547978432dfe2dbc1ffcd)
I20260429 19:54:58.012274 11463 raft_consensus.cc:515] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
I20260429 19:54:58.012835 11463 leader_election.cc:290] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:54:58.013563 10679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d4a1fea40d4f60866e5c4e8d75c743" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 4 candidate_status { last_received { term: 3 index: 1203 } } ignore_live_leader: false dest_uuid: "5db99103528644b2b88c22cbd1a26046" is_pre_election: true
I20260429 19:54:58.016052 10809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d4a1fea40d4f60866e5c4e8d75c743" candidate_uuid: "b874a660f9d74e30bd258ed4e690aea1" candidate_term: 4 candidate_status { last_received { term: 3 index: 1203 } } ignore_live_leader: false dest_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" is_pre_election: true
I20260429 19:54:58.016559 11276 leader_election.cc:304] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b874a660f9d74e30bd258ed4e690aea1; no voters: 5db99103528644b2b88c22cbd1a26046, 9b091bf2bbc547978432dfe2dbc1ffcd
I20260429 19:54:58.017524 11463 raft_consensus.cc:2749] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260429 19:54:58.929144 11189 ts_manager.cc:284] Unset tserver state for b874a660f9d74e30bd258ed4e690aea1 from MAINTENANCE_MODE
I20260429 19:54:58.939371 10855 heartbeater.cc:507] Master 127.10.32.126:41131 requested a full tablet report, sending...
I20260429 19:54:58.981981 11103 heartbeater.cc:507] Master 127.10.32.126:41131 requested a full tablet report, sending...
I20260429 19:54:59.609441 11404 heartbeater.cc:507] Master 127.10.32.126:41131 requested a full tablet report, sending...
I20260429 19:54:59.746784 10725 heartbeater.cc:507] Master 127.10.32.126:41131 requested a full tablet report, sending...
I20260429 19:55:02.346202 11188 ts_manager.cc:295] Set tserver state for b874a660f9d74e30bd258ed4e690aea1 to MAINTENANCE_MODE
I20260429 19:55:02.347002 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 11259
I20260429 19:55:02.348089 11398 generic_service.cc:196] Checking for leaks (request via RPC)
W20260429 19:55:03.174122 11398 rpcz_store.cc:267] Call kudu.server.GenericService.CheckLeaks from 127.0.0.1:59566 (request call id 69) took 826 ms (client timeout 1000 ms). Trace:
I20260429 19:55:03.243551 11503 raft_consensus.cc:493] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b091bf2bbc547978432dfe2dbc1ffcd)
I20260429 19:55:03.243716 11503 raft_consensus.cc:515] T 94d4a1fea40d4f60866e5c4e8d75c743 P b874a660f9d74e30bd258ed4e690aea1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } }
W20260429 19:55:03.241675 11398 rpcz_store.cc:269] 0429 19:55:02.347767 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 19:55:02.347858 (+ 91us) service_pool.cc:225] Handling call
0429 19:55:03.174080 (+826222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260429 19:55:03.249645 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 11259
W20260429 19:55:03.357384 10616 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.32.65:42197 (error 108) [suppressed 65 similar messages]
W20260429 19:55:03.372377 10746 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.32.65:42197 (error 108) [suppressed 23 similar messages]
W20260429 19:55:03.388919 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260429 19:55:03.389065 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260429 19:55:03.389149 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260429 19:55:03.389216 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260429 19:55:03.390087 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260429 19:55:03.390286 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260429 19:55:03.835204 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260429 19:55:03.857744 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260429 19:55:03.880861 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260429 19:55:03.882835 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260429 19:55:03.906437 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260429 19:55:03.936228 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260429 19:55:04.293236 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260429 19:55:04.353665 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260429 19:55:04.359069 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260429 19:55:04.376322 11513 consensus_queue.cc:579] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Leader has been unable to successfully communicate with peer b874a660f9d74e30bd258ed4e690aea1 for more than 2 seconds (2.033s)
W20260429 19:55:04.416496 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260429 19:55:04.438375 11519 consensus_queue.cc:579] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [LEADER]: Leader has been unable to successfully communicate with peer b874a660f9d74e30bd258ed4e690aea1 for more than 2 seconds (2.094s)
W20260429 19:55:04.467880 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260429 19:55:04.478189 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260429 19:55:04.812635 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260429 19:55:04.867033 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260429 19:55:04.876593 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260429 19:55:04.893041 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260429 19:55:05.030055 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260429 19:55:05.074478 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260429 19:55:05.251914 11494 consensus_queue.cc:579] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [LEADER]: Leader has been unable to successfully communicate with peer b874a660f9d74e30bd258ed4e690aea1 for more than 2 seconds (2.029s)
I20260429 19:55:05.276322 11513 consensus_queue.cc:579] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Leader has been unable to successfully communicate with peer b874a660f9d74e30bd258ed4e690aea1 for more than 2 seconds (2.044s)
I20260429 19:55:05.279465 11518 consensus_queue.cc:579] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Leader has been unable to successfully communicate with peer b874a660f9d74e30bd258ed4e690aea1 for more than 2 seconds (2.039s)
I20260429 19:55:05.304095 11513 consensus_queue.cc:579] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Leader has been unable to successfully communicate with peer b874a660f9d74e30bd258ed4e690aea1 for more than 2 seconds (2.066s)
W20260429 19:55:05.316673 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260429 19:55:05.372413 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260429 19:55:05.382239 11188 ts_manager.cc:284] Unset tserver state for b874a660f9d74e30bd258ed4e690aea1 from MAINTENANCE_MODE
W20260429 19:55:05.398851 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260429 19:55:05.404312 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260429 19:55:05.541411 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260429 19:55:05.565899 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260429 19:55:05.818686 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260429 19:55:05.870754 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260429 19:55:05.878266 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260429 19:55:05.904747 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260429 19:55:06.007138 11103 heartbeater.cc:507] Master 127.10.32.126:41131 requested a full tablet report, sending...
W20260429 19:55:06.017901 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260429 19:55:06.098618 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260429 19:55:06.262135 10855 heartbeater.cc:507] Master 127.10.32.126:41131 requested a full tablet report, sending...
I20260429 19:55:06.311615 10725 heartbeater.cc:507] Master 127.10.32.126:41131 requested a full tablet report, sending...
W20260429 19:55:06.318298 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260429 19:55:06.318790 10806 consensus_queue.cc:237] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1833, Committed index: 1833, Last appended: 2.1834, Last appended by leader: 148, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1835 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } }
I20260429 19:55:06.326695 10804 consensus_queue.cc:237] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1834, Committed index: 1834, Last appended: 3.1835, Last appended by leader: 149, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1836 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } }
I20260429 19:55:06.329562 10677 raft_consensus.cc:1275] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [term 2 FOLLOWER]: Refusing update from remote peer 9b091bf2bbc547978432dfe2dbc1ffcd: Log matching property violated. Preceding OpId in replica: term: 2 index: 1834. Preceding OpId from leader: term: 2 index: 1835. (index mismatch)
I20260429 19:55:06.330020 10679 raft_consensus.cc:1275] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 3 FOLLOWER]: Refusing update from remote peer 9b091bf2bbc547978432dfe2dbc1ffcd: Log matching property violated. Preceding OpId in replica: term: 3 index: 1834. Preceding OpId from leader: term: 3 index: 1836. (index mismatch)
I20260429 19:55:06.330814 11494 consensus_queue.cc:1048] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1835, Last known committed idx: 1833, Time since last communication: 0.000s
I20260429 19:55:06.331401 11530 consensus_queue.cc:1050] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 }, Status: LMP_MISMATCH, Last received: 3.1834, Next index: 1835, Last known committed idx: 1834, Time since last communication: 0.000s
I20260429 19:55:06.335398 11494 raft_consensus.cc:2955] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 3 LEADER]: Committing config change with OpId 3.1836: config changed from index -1 to 1836, NON_VOTER b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68) added. New config: { opid_index: 1836 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } } }
I20260429 19:55:06.339346 11530 raft_consensus.cc:2955] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 LEADER]: Committing config change with OpId 2.1835: config changed from index -1 to 1835, NON_VOTER b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68) added. New config: { opid_index: 1835 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } } }
I20260429 19:55:06.348515 11174 catalog_manager.cc:5184] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 815a20bb06ab452d8dcf0ca2592b5f5d with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260429 19:55:06.348306 10679 raft_consensus.cc:2955] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 3 FOLLOWER]: Committing config change with OpId 3.1836: config changed from index -1 to 1836, NON_VOTER b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68) added. New config: { opid_index: 1836 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } } }
I20260429 19:55:06.349023 11174 catalog_manager.cc:5184] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 94d4a1fea40d4f60866e5c4e8d75c743 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260429 19:55:06.349558 10677 raft_consensus.cc:2955] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 [term 2 FOLLOWER]: Committing config change with OpId 2.1835: config changed from index -1 to 1835, NON_VOTER b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68) added. New config: { opid_index: 1835 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } } }
I20260429 19:55:06.356763 11189 catalog_manager.cc:5671] T 815a20bb06ab452d8dcf0ca2592b5f5d P 5db99103528644b2b88c22cbd1a26046 reported cstate change: config changed from index -1 to 1835, NON_VOTER b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68) added. New cstate: current_term: 2 leader_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" committed_config { opid_index: 1835 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } } }
I20260429 19:55:06.361616 11188 catalog_manager.cc:5671] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd reported cstate change: config changed from index -1 to 1836, NON_VOTER b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68) added. New cstate: current_term: 3 leader_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" committed_config { opid_index: 1836 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260429 19:55:06.372630 10678 consensus_queue.cc:237] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1833, Committed index: 1833, Last appended: 1.1837, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1838 OBSOLETE_local: false peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } }
I20260429 19:55:06.372916 10677 consensus_queue.cc:237] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1833, Committed index: 1833, Last appended: 1.1837, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1838 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } }
I20260429 19:55:06.372956 10676 consensus_queue.cc:237] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1834, Committed index: 1834, Last appended: 2.1838, Last appended by leader: 149, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1839 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } }
I20260429 19:55:06.375532 10680 consensus_queue.cc:237] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1834, Committed index: 1834, Last appended: 2.1838, Last appended by leader: 148, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1839 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } }
W20260429 19:55:06.382457 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260429 19:55:06.382814 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260429 19:55:06.383013 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260429 19:55:06.384553 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260429 19:55:06.385457 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 815a20bb06ab452d8dcf0ca2592b5f5d. This is attempt 1: this message will repeat every 5th retry.
W20260429 19:55:06.385705 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 94d4a1fea40d4f60866e5c4e8d75c743. This is attempt 1: this message will repeat every 5th retry.
I20260429 19:55:06.386209 10806 raft_consensus.cc:1275] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Refusing update from remote peer 5db99103528644b2b88c22cbd1a26046: Log matching property violated. Preceding OpId in replica: term: 2 index: 1835. Preceding OpId from leader: term: 2 index: 1839. (index mismatch)
I20260429 19:55:06.386349 10804 raft_consensus.cc:1275] T f841352e6f584a97a0f2801c9d8651a7 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Refusing update from remote peer 5db99103528644b2b88c22cbd1a26046: Log matching property violated. Preceding OpId in replica: term: 1 index: 1834. Preceding OpId from leader: term: 1 index: 1838. (index mismatch)
W20260429 19:55:06.386570 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260429 19:55:06.386654 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260429 19:55:06.387013 10808 raft_consensus.cc:1275] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Refusing update from remote peer 5db99103528644b2b88c22cbd1a26046: Log matching property violated. Preceding OpId in replica: term: 1 index: 1834. Preceding OpId from leader: term: 1 index: 1838. (index mismatch)
I20260429 19:55:06.386989 11518 consensus_queue.cc:1048] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1839, Last known committed idx: 1834, Time since last communication: 0.000s
I20260429 19:55:06.387393 10805 raft_consensus.cc:1275] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Refusing update from remote peer 5db99103528644b2b88c22cbd1a26046: Log matching property violated. Preceding OpId in replica: term: 2 index: 1835. Preceding OpId from leader: term: 2 index: 1839. (index mismatch)
I20260429 19:55:06.387811 11513 consensus_queue.cc:1048] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1838, Last known committed idx: 1833, Time since last communication: 0.000s
I20260429 19:55:06.388007 11490 consensus_queue.cc:1048] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1838, Last known committed idx: 1833, Time since last communication: 0.000s
I20260429 19:55:06.388284 11513 consensus_queue.cc:1048] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1839, Last known committed idx: 1834, Time since last communication: 0.000s
W20260429 19:55:06.391324 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: de046e6b43a7413fa6e9a65e426f4721. This is attempt 1: this message will repeat every 5th retry.
W20260429 19:55:06.391573 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3449d2f7451d4a758233c5a1372a2960. This is attempt 1: this message will repeat every 5th retry.
W20260429 19:55:06.391764 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b920d515ed1846c2a4b44b05f05f9886. This is attempt 1: this message will repeat every 5th retry.
W20260429 19:55:06.391968 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f841352e6f584a97a0f2801c9d8651a7. This is attempt 1: this message will repeat every 5th retry.
I20260429 19:55:06.392701 11501 raft_consensus.cc:2955] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [term 2 LEADER]: Committing config change with OpId 2.1839: config changed from index -1 to 1839, NON_VOTER b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68) added. New config: { opid_index: 1839 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } } }
I20260429 19:55:06.393234 10804 raft_consensus.cc:2955] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Committing config change with OpId 2.1839: config changed from index -1 to 1839, NON_VOTER b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68) added. New config: { opid_index: 1839 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } } }
I20260429 19:55:06.398872 11534 raft_consensus.cc:2955] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [term 2 LEADER]: Committing config change with OpId 2.1839: config changed from index -1 to 1839, NON_VOTER b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68) added. New config: { opid_index: 1839 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } } }
I20260429 19:55:06.399027 11513 raft_consensus.cc:2955] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 [term 1 LEADER]: Committing config change with OpId 1.1838: config changed from index -1 to 1838, NON_VOTER b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68) added. New config: { opid_index: 1838 OBSOLETE_local: false peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } } }
I20260429 19:55:06.403142 11174 catalog_manager.cc:5184] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet de046e6b43a7413fa6e9a65e426f4721 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260429 19:55:06.403436 11174 catalog_manager.cc:5184] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet b920d515ed1846c2a4b44b05f05f9886 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260429 19:55:06.403594 11174 catalog_manager.cc:5184] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 3449d2f7451d4a758233c5a1372a2960 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260429 19:55:06.403375 11518 raft_consensus.cc:2955] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [term 1 LEADER]: Committing config change with OpId 1.1838: config changed from index -1 to 1838, NON_VOTER b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68) added. New config: { opid_index: 1838 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } } }
I20260429 19:55:06.408193 10806 raft_consensus.cc:2955] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Committing config change with OpId 1.1838: config changed from index -1 to 1838, NON_VOTER b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68) added. New config: { opid_index: 1838 OBSOLETE_local: false peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } } }
I20260429 19:55:06.412235 11174 catalog_manager.cc:5184] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet f841352e6f584a97a0f2801c9d8651a7 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260429 19:55:06.441220 10808 raft_consensus.cc:2955] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Committing config change with OpId 2.1839: config changed from index -1 to 1839, NON_VOTER b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68) added. New config: { opid_index: 1839 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } } }
I20260429 19:55:06.442839 11542 ts_tablet_manager.cc:933] T 815a20bb06ab452d8dcf0ca2592b5f5d P b35a6fb6005540cd8229f95c6f8cb3e5: Initiating tablet copy from peer 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:55:06.446130 10806 raft_consensus.cc:2955] T f841352e6f584a97a0f2801c9d8651a7 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Committing config change with OpId 1.1838: config changed from index -1 to 1838, NON_VOTER b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68) added. New config: { opid_index: 1838 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } } }
I20260429 19:55:06.451148 11542 tablet_copy_client.cc:323] T 815a20bb06ab452d8dcf0ca2592b5f5d P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Beginning tablet copy session from remote peer at address 127.10.32.67:38317
I20260429 19:55:06.477026 11548 ts_tablet_manager.cc:933] T 94d4a1fea40d4f60866e5c4e8d75c743 P b35a6fb6005540cd8229f95c6f8cb3e5: Initiating tablet copy from peer 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:55:06.494774 11548 tablet_copy_client.cc:323] T 94d4a1fea40d4f60866e5c4e8d75c743 P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Beginning tablet copy session from remote peer at address 127.10.32.67:38317
I20260429 19:55:06.505195 10830 tablet_copy_service.cc:140] P 9b091bf2bbc547978432dfe2dbc1ffcd: Received BeginTabletCopySession request for tablet 815a20bb06ab452d8dcf0ca2592b5f5d from peer b35a6fb6005540cd8229f95c6f8cb3e5 ({username='slave'} at 127.10.32.68:46047)
I20260429 19:55:06.505439 10830 tablet_copy_service.cc:161] P 9b091bf2bbc547978432dfe2dbc1ffcd: Beginning new tablet copy session on tablet 815a20bb06ab452d8dcf0ca2592b5f5d from peer b35a6fb6005540cd8229f95c6f8cb3e5 at {username='slave'} at 127.10.32.68:46047: session id = b35a6fb6005540cd8229f95c6f8cb3e5-815a20bb06ab452d8dcf0ca2592b5f5d
I20260429 19:55:06.505226 10829 tablet_copy_service.cc:140] P 9b091bf2bbc547978432dfe2dbc1ffcd: Received BeginTabletCopySession request for tablet 94d4a1fea40d4f60866e5c4e8d75c743 from peer b35a6fb6005540cd8229f95c6f8cb3e5 ({username='slave'} at 127.10.32.68:46047)
I20260429 19:55:06.507956 10829 tablet_copy_service.cc:161] P 9b091bf2bbc547978432dfe2dbc1ffcd: Beginning new tablet copy session on tablet 94d4a1fea40d4f60866e5c4e8d75c743 from peer b35a6fb6005540cd8229f95c6f8cb3e5 at {username='slave'} at 127.10.32.68:46047: session id = b35a6fb6005540cd8229f95c6f8cb3e5-94d4a1fea40d4f60866e5c4e8d75c743
I20260429 19:55:06.511649 11551 ts_tablet_manager.cc:933] T de046e6b43a7413fa6e9a65e426f4721 P b35a6fb6005540cd8229f95c6f8cb3e5: Initiating tablet copy from peer 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183)
I20260429 19:55:06.511718 10829 tablet_copy_source_session.cc:215] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd: Tablet Copy: opened 0 blocks and 1 log segments
I20260429 19:55:06.512634 11547 ts_tablet_manager.cc:933] T 3449d2f7451d4a758233c5a1372a2960 P b35a6fb6005540cd8229f95c6f8cb3e5: Initiating tablet copy from peer 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183)
I20260429 19:55:06.515990 10830 tablet_copy_source_session.cc:215] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd: Tablet Copy: opened 0 blocks and 1 log segments
I20260429 19:55:06.521618 11542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 815a20bb06ab452d8dcf0ca2592b5f5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:55:06.522145 11548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94d4a1fea40d4f60866e5c4e8d75c743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:55:06.520195 11549 ts_tablet_manager.cc:933] T b920d515ed1846c2a4b44b05f05f9886 P b35a6fb6005540cd8229f95c6f8cb3e5: Initiating tablet copy from peer 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183)
I20260429 19:55:06.539213 11551 tablet_copy_client.cc:323] T de046e6b43a7413fa6e9a65e426f4721 P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Beginning tablet copy session from remote peer at address 127.10.32.66:41183
I20260429 19:55:06.540679 11542 tablet_copy_client.cc:806] T 815a20bb06ab452d8dcf0ca2592b5f5d P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Starting download of 0 data blocks...
I20260429 19:55:06.541110 11542 tablet_copy_client.cc:670] T 815a20bb06ab452d8dcf0ca2592b5f5d P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Starting download of 1 WAL segments...
I20260429 19:55:06.541312 11548 tablet_copy_client.cc:806] T 94d4a1fea40d4f60866e5c4e8d75c743 P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Starting download of 0 data blocks...
I20260429 19:55:06.541574 11548 tablet_copy_client.cc:670] T 94d4a1fea40d4f60866e5c4e8d75c743 P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Starting download of 1 WAL segments...
I20260429 19:55:06.550823 11544 ts_tablet_manager.cc:933] T f841352e6f584a97a0f2801c9d8651a7 P b35a6fb6005540cd8229f95c6f8cb3e5: Initiating tablet copy from peer 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183)
I20260429 19:55:06.565546 11548 tablet_copy_client.cc:538] T 94d4a1fea40d4f60866e5c4e8d75c743 P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260429 19:55:06.554041 11547 tablet_copy_client.cc:323] T 3449d2f7451d4a758233c5a1372a2960 P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Beginning tablet copy session from remote peer at address 127.10.32.66:41183
I20260429 19:55:06.573734 11542 tablet_copy_client.cc:538] T 815a20bb06ab452d8dcf0ca2592b5f5d P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260429 19:55:06.579010 11542 tablet_bootstrap.cc:492] T 815a20bb06ab452d8dcf0ca2592b5f5d P b35a6fb6005540cd8229f95c6f8cb3e5: Bootstrap starting.
I20260429 19:55:06.580818 11549 tablet_copy_client.cc:323] T b920d515ed1846c2a4b44b05f05f9886 P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Beginning tablet copy session from remote peer at address 127.10.32.66:41183
I20260429 19:55:06.585593 10700 tablet_copy_service.cc:140] P 5db99103528644b2b88c22cbd1a26046: Received BeginTabletCopySession request for tablet de046e6b43a7413fa6e9a65e426f4721 from peer b35a6fb6005540cd8229f95c6f8cb3e5 ({username='slave'} at 127.10.32.68:49065)
I20260429 19:55:06.585872 10700 tablet_copy_service.cc:161] P 5db99103528644b2b88c22cbd1a26046: Beginning new tablet copy session on tablet de046e6b43a7413fa6e9a65e426f4721 from peer b35a6fb6005540cd8229f95c6f8cb3e5 at {username='slave'} at 127.10.32.68:49065: session id = b35a6fb6005540cd8229f95c6f8cb3e5-de046e6b43a7413fa6e9a65e426f4721
I20260429 19:55:06.588894 10699 tablet_copy_service.cc:140] P 5db99103528644b2b88c22cbd1a26046: Received BeginTabletCopySession request for tablet 3449d2f7451d4a758233c5a1372a2960 from peer b35a6fb6005540cd8229f95c6f8cb3e5 ({username='slave'} at 127.10.32.68:49065)
I20260429 19:55:06.573688 11548 tablet_bootstrap.cc:492] T 94d4a1fea40d4f60866e5c4e8d75c743 P b35a6fb6005540cd8229f95c6f8cb3e5: Bootstrap starting.
I20260429 19:55:06.589210 10699 tablet_copy_service.cc:161] P 5db99103528644b2b88c22cbd1a26046: Beginning new tablet copy session on tablet 3449d2f7451d4a758233c5a1372a2960 from peer b35a6fb6005540cd8229f95c6f8cb3e5 at {username='slave'} at 127.10.32.68:49065: session id = b35a6fb6005540cd8229f95c6f8cb3e5-3449d2f7451d4a758233c5a1372a2960
I20260429 19:55:06.592978 10699 tablet_copy_source_session.cc:215] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046: Tablet Copy: opened 0 blocks and 1 log segments
I20260429 19:55:06.589761 10698 tablet_copy_service.cc:140] P 5db99103528644b2b88c22cbd1a26046: Received BeginTabletCopySession request for tablet b920d515ed1846c2a4b44b05f05f9886 from peer b35a6fb6005540cd8229f95c6f8cb3e5 ({username='slave'} at 127.10.32.68:49065)
I20260429 19:55:06.593921 10698 tablet_copy_service.cc:161] P 5db99103528644b2b88c22cbd1a26046: Beginning new tablet copy session on tablet b920d515ed1846c2a4b44b05f05f9886 from peer b35a6fb6005540cd8229f95c6f8cb3e5 at {username='slave'} at 127.10.32.68:49065: session id = b35a6fb6005540cd8229f95c6f8cb3e5-b920d515ed1846c2a4b44b05f05f9886
I20260429 19:55:06.600581 10698 tablet_copy_source_session.cc:215] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046: Tablet Copy: opened 0 blocks and 1 log segments
I20260429 19:55:06.593755 10700 tablet_copy_source_session.cc:215] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046: Tablet Copy: opened 0 blocks and 1 log segments
I20260429 19:55:06.603711 11551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de046e6b43a7413fa6e9a65e426f4721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:55:06.606422 11547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3449d2f7451d4a758233c5a1372a2960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:55:06.610044 11549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b920d515ed1846c2a4b44b05f05f9886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:55:06.617324 11547 tablet_copy_client.cc:806] T 3449d2f7451d4a758233c5a1372a2960 P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Starting download of 0 data blocks...
I20260429 19:55:06.617693 11547 tablet_copy_client.cc:670] T 3449d2f7451d4a758233c5a1372a2960 P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Starting download of 1 WAL segments...
I20260429 19:55:06.630029 11547 tablet_copy_client.cc:538] T 3449d2f7451d4a758233c5a1372a2960 P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260429 19:55:06.633749 11547 tablet_bootstrap.cc:492] T 3449d2f7451d4a758233c5a1372a2960 P b35a6fb6005540cd8229f95c6f8cb3e5: Bootstrap starting.
I20260429 19:55:06.638708 11544 tablet_copy_client.cc:323] T f841352e6f584a97a0f2801c9d8651a7 P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Beginning tablet copy session from remote peer at address 127.10.32.66:41183
I20260429 19:55:06.643412 11549 tablet_copy_client.cc:806] T b920d515ed1846c2a4b44b05f05f9886 P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Starting download of 0 data blocks...
I20260429 19:55:06.645247 11189 catalog_manager.cc:5671] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 reported cstate change: config changed from index -1 to 1838, NON_VOTER b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68) added. New cstate: current_term: 1 leader_uuid: "5db99103528644b2b88c22cbd1a26046" committed_config { opid_index: 1838 OBSOLETE_local: false peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260429 19:55:06.645916 11189 catalog_manager.cc:5671] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 reported cstate change: config changed from index -1 to 1839, NON_VOTER b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68) added. New cstate: current_term: 2 leader_uuid: "5db99103528644b2b88c22cbd1a26046" committed_config { opid_index: 1839 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260429 19:55:06.646817 11189 catalog_manager.cc:5671] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 reported cstate change: config changed from index -1 to 1838, NON_VOTER b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68) added. New cstate: current_term: 1 leader_uuid: "5db99103528644b2b88c22cbd1a26046" committed_config { opid_index: 1838 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260429 19:55:06.647444 11189 catalog_manager.cc:5671] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 reported cstate change: config changed from index -1 to 1839, NON_VOTER b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68) added. New cstate: current_term: 2 leader_uuid: "5db99103528644b2b88c22cbd1a26046" committed_config { opid_index: 1839 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260429 19:55:06.651952 10700 tablet_copy_service.cc:140] P 5db99103528644b2b88c22cbd1a26046: Received BeginTabletCopySession request for tablet f841352e6f584a97a0f2801c9d8651a7 from peer b35a6fb6005540cd8229f95c6f8cb3e5 ({username='slave'} at 127.10.32.68:49065)
I20260429 19:55:06.652158 10700 tablet_copy_service.cc:161] P 5db99103528644b2b88c22cbd1a26046: Beginning new tablet copy session on tablet f841352e6f584a97a0f2801c9d8651a7 from peer b35a6fb6005540cd8229f95c6f8cb3e5 at {username='slave'} at 127.10.32.68:49065: session id = b35a6fb6005540cd8229f95c6f8cb3e5-f841352e6f584a97a0f2801c9d8651a7
I20260429 19:55:06.655789 10700 tablet_copy_source_session.cc:215] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046: Tablet Copy: opened 0 blocks and 1 log segments
I20260429 19:55:06.646458 11551 tablet_copy_client.cc:806] T de046e6b43a7413fa6e9a65e426f4721 P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Starting download of 0 data blocks...
I20260429 19:55:06.657498 11544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f841352e6f584a97a0f2801c9d8651a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:55:06.659636 11551 tablet_copy_client.cc:670] T de046e6b43a7413fa6e9a65e426f4721 P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Starting download of 1 WAL segments...
I20260429 19:55:06.667359 11544 tablet_copy_client.cc:806] T f841352e6f584a97a0f2801c9d8651a7 P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Starting download of 0 data blocks...
I20260429 19:55:06.667672 11544 tablet_copy_client.cc:670] T f841352e6f584a97a0f2801c9d8651a7 P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Starting download of 1 WAL segments...
I20260429 19:55:06.681392 11551 tablet_copy_client.cc:538] T de046e6b43a7413fa6e9a65e426f4721 P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260429 19:55:06.681656 11549 tablet_copy_client.cc:670] T b920d515ed1846c2a4b44b05f05f9886 P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Starting download of 1 WAL segments...
I20260429 19:55:06.697499 11544 tablet_copy_client.cc:538] T f841352e6f584a97a0f2801c9d8651a7 P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260429 19:55:06.704250 11551 tablet_bootstrap.cc:492] T de046e6b43a7413fa6e9a65e426f4721 P b35a6fb6005540cd8229f95c6f8cb3e5: Bootstrap starting.
I20260429 19:55:06.707317 11544 tablet_bootstrap.cc:492] T f841352e6f584a97a0f2801c9d8651a7 P b35a6fb6005540cd8229f95c6f8cb3e5: Bootstrap starting.
I20260429 19:55:06.717849 11549 tablet_copy_client.cc:538] T b920d515ed1846c2a4b44b05f05f9886 P b35a6fb6005540cd8229f95c6f8cb3e5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260429 19:55:06.721844 11549 tablet_bootstrap.cc:492] T b920d515ed1846c2a4b44b05f05f9886 P b35a6fb6005540cd8229f95c6f8cb3e5: Bootstrap starting.
W20260429 19:55:06.833149 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260429 19:55:06.878871 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260429 19:55:06.884301 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260429 19:55:06.896827 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260429 19:55:06.904152 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260429 19:55:06.976665 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260429 19:55:07.017825 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260429 19:55:07.022650 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260429 19:55:07.047504 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260429 19:55:07.050724 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260429 19:55:07.057797 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260429 19:55:07.100805 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260429 19:55:07.329088 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260429 19:55:07.361513 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260429 19:55:07.391417 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260429 19:55:07.413280 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260429 19:55:07.434374 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260429 19:55:07.471768 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260429 19:55:07.480027 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260429 19:55:07.481137 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260429 19:55:07.553213 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260429 19:55:07.574919 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260429 19:55:07.586910 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260429 19:55:07.614204 10616 consensus_peers.cc:597] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260429 19:55:07.812659 11547 log.cc:826] T 3449d2f7451d4a758233c5a1372a2960 P b35a6fb6005540cd8229f95c6f8cb3e5: Log is configured to *not* fsync() on all Append() calls
W20260429 19:55:07.825702 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260429 19:55:07.868975 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260429 19:55:07.900360 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
W20260429 19:55:07.910604 10616 consensus_peers.cc:597] T 3449d2f7451d4a758233c5a1372a2960 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260429 19:55:07.923038 10616 consensus_peers.cc:597] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260429 19:55:07.946213 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260429 19:55:08.007777 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
W20260429 19:55:08.014448 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
W20260429 19:55:08.031391 10616 consensus_peers.cc:597] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
I20260429 19:55:08.041002 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 10598
I20260429 19:55:08.043443 10720 generic_service.cc:196] Checking for leaks (request via RPC)
I20260429 19:55:08.238582 11577 raft_consensus.cc:493] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:55:08.238785 11577 raft_consensus.cc:515] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1838 OBSOLETE_local: false peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } }
I20260429 19:55:08.239569 11577 leader_election.cc:290] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183), b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197)
W20260429 19:55:08.241432 10746 leader_election.cc:336] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111)
I20260429 19:55:08.257951 11577 raft_consensus.cc:493] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:55:08.258208 11577 raft_consensus.cc:515] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 1839 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } }
I20260429 19:55:08.259009 11577 leader_election.cc:290] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183)
W20260429 19:55:08.260720 10746 leader_election.cc:336] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111)
W20260429 19:55:08.293422 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260429 19:55:08.296779 11577 raft_consensus.cc:493] T f841352e6f584a97a0f2801c9d8651a7 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:55:08.296976 11577 raft_consensus.cc:515] T f841352e6f584a97a0f2801c9d8651a7 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1838 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } }
I20260429 19:55:08.297654 11577 leader_election.cc:290] T f841352e6f584a97a0f2801c9d8651a7 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183)
W20260429 19:55:08.299150 10746 leader_election.cc:336] T f841352e6f584a97a0f2801c9d8651a7 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111)
I20260429 19:55:08.303294 11577 raft_consensus.cc:493] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:55:08.303511 11577 raft_consensus.cc:515] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 1839 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } }
I20260429 19:55:08.304272 11577 leader_election.cc:290] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183)
W20260429 19:55:08.305817 10746 leader_election.cc:336] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111)
I20260429 19:55:08.402611 11577 consensus_queue.cc:579] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd [LEADER]: Leader has been unable to successfully communicate with peer b874a660f9d74e30bd258ed4e690aea1 for more than 2 seconds (2.075s)
W20260429 19:55:08.404052 10746 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111) [suppressed 101 similar messages]
W20260429 19:55:08.405230 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197): Couldn't send request to peer b874a660f9d74e30bd258ed4e690aea1. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:42197: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260429 19:55:08.406816 11577 consensus_queue.cc:579] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd [LEADER]: Leader has been unable to successfully communicate with peer b874a660f9d74e30bd258ed4e690aea1 for more than 2 seconds (2.088s)
W20260429 19:55:08.458295 10746 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 21: this message will repeat every 5th retry.
W20260429 19:55:08.511178 10746 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer b35a6fb6005540cd8229f95c6f8cb3e5 (127.10.32.68:39027): Couldn't send request to peer b35a6fb6005540cd8229f95c6f8cb3e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 21: this message will repeat every 5th retry.
I20260429 19:55:08.596594 11501 consensus_queue.cc:579] T b920d515ed1846c2a4b44b05f05f9886 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Leader has been unable to successfully communicate with peer b874a660f9d74e30bd258ed4e690aea1 for more than 2 seconds (2.221s)
I20260429 19:55:08.597383 11580 consensus_queue.cc:579] T f841352e6f584a97a0f2801c9d8651a7 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Leader has been unable to successfully communicate with peer b874a660f9d74e30bd258ed4e690aea1 for more than 2 seconds (2.224s)
I20260429 19:55:08.617022 11534 raft_consensus.cc:493] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b091bf2bbc547978432dfe2dbc1ffcd)
I20260429 19:55:08.617642 11501 consensus_queue.cc:579] T de046e6b43a7413fa6e9a65e426f4721 P 5db99103528644b2b88c22cbd1a26046 [LEADER]: Leader has been unable to successfully communicate with peer b874a660f9d74e30bd258ed4e690aea1 for more than 2 seconds (2.244s)
I20260429 19:55:08.619050 11534 raft_consensus.cc:515] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 1836 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } }
I20260429 19:55:08.619794 11534 leader_election.cc:290] T 94d4a1fea40d4f60866e5c4e8d75c743 P 5db99103528644b2b88c22cbd1a26046 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 9b091bf2bbc547978432dfe2dbc1ffcd (127.10.32.67:38317)
I20260429 19:55:08.619911 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 10598
W20260429 19:55:08.745026 10744 connection.cc:570] client connection to 127.10.32.66:41183 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260429 19:55:08.745219 10744 leader_election.cc:336] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260429 19:55:08.745352 10744 leader_election.cc:304] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b091bf2bbc547978432dfe2dbc1ffcd; no voters: 5db99103528644b2b88c22cbd1a26046, b874a660f9d74e30bd258ed4e690aea1
W20260429 19:55:08.745751 10744 leader_election.cc:336] T f841352e6f584a97a0f2801c9d8651a7 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260429 19:55:08.745863 10744 leader_election.cc:304] T f841352e6f584a97a0f2801c9d8651a7 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b091bf2bbc547978432dfe2dbc1ffcd; no voters: 5db99103528644b2b88c22cbd1a26046, b874a660f9d74e30bd258ed4e690aea1
W20260429 19:55:08.746160 10744 leader_election.cc:336] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260429 19:55:08.746277 10744 leader_election.cc:304] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b091bf2bbc547978432dfe2dbc1ffcd; no voters: 5db99103528644b2b88c22cbd1a26046, b874a660f9d74e30bd258ed4e690aea1
W20260429 19:55:08.746574 10744 leader_election.cc:336] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260429 19:55:08.746685 10744 leader_election.cc:304] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b091bf2bbc547978432dfe2dbc1ffcd; no voters: 5db99103528644b2b88c22cbd1a26046, b874a660f9d74e30bd258ed4e690aea1
I20260429 19:55:08.747885 11577 raft_consensus.cc:2749] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260429 19:55:08.748203 11577 raft_consensus.cc:2749] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260429 19:55:08.748387 11568 raft_consensus.cc:2749] T f841352e6f584a97a0f2801c9d8651a7 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 19:55:08.748525 11578 raft_consensus.cc:2749] T 3449d2f7451d4a758233c5a1372a2960 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 19:55:08.749007 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 10728
W20260429 19:55:08.748540 10983 connection.cc:570] server connection from 127.10.32.66:55599 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260429 19:55:08.750006 10850 generic_service.cc:196] Checking for leaks (request via RPC)
W20260429 19:55:08.750443 10744 consensus_peers.cc:597] T 94d4a1fea40d4f60866e5c4e8d75c743 P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183): Couldn't send request to peer 5db99103528644b2b88c22cbd1a26046. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.66:41183: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260429 19:55:09.258375 11568 raft_consensus.cc:493] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
W20260429 19:55:09.259014 10744 consensus_peers.cc:597] T 815a20bb06ab452d8dcf0ca2592b5f5d P 9b091bf2bbc547978432dfe2dbc1ffcd -> Peer 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183): Couldn't send request to peer 5db99103528644b2b88c22cbd1a26046. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.66:41183: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260429 19:55:09.259177 10744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.32.66:41183, user_credentials={real_user=slave}} blocked reactor thread for 508249us
I20260429 19:55:09.259337 11568 raft_consensus.cc:515] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 1839 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } }
I20260429 19:55:09.259740 11586 raft_consensus.cc:493] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5db99103528644b2b88c22cbd1a26046)
I20260429 19:55:09.259893 11586 raft_consensus.cc:515] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 1839 OBSOLETE_local: false peers { permanent_uuid: "b874a660f9d74e30bd258ed4e690aea1" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 42197 } } peers { permanent_uuid: "5db99103528644b2b88c22cbd1a26046" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 41183 } } peers { permanent_uuid: "9b091bf2bbc547978432dfe2dbc1ffcd" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 38317 } } peers { permanent_uuid: "b35a6fb6005540cd8229f95c6f8cb3e5" member_type: NON_VOTER last_known_addr { host: "127.10.32.68" port: 39027 } attrs { promote: true } }
I20260429 19:55:09.260016 11568 leader_election.cc:290] T b920d515ed1846c2a4b44b05f05f9886 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183)
I20260429 19:55:09.260434 11586 leader_election.cc:290] T de046e6b43a7413fa6e9a65e426f4721 P 9b091bf2bbc547978432dfe2dbc1ffcd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b874a660f9d74e30bd258ed4e690aea1 (127.10.32.65:42197), 5db99103528644b2b88c22cbd1a26046 (127.10.32.66:41183)
I20260429 19:55:09.264173 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 10728
W20260429 19:55:09.373440 11176 connection.cc:570] server connection from 127.10.32.67:36665 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260429 19:55:09.374243 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 10940
I20260429 19:55:09.376379 11098 generic_service.cc:196] Checking for leaks (request via RPC)
I20260429 19:55:09.590764 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 10940
I20260429 19:55:09.618227 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 11155
I20260429 19:55:09.619511 11219 generic_service.cc:196] Checking for leaks (request via RPC)
I20260429 19:55:09.727685 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 11155
2026-04-29T19:55:09Z chronyd exiting
[ OK ] MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate (43990 ms)
[----------] 1 test from MaintenanceModeRF3ITest (43990 ms total)
[----------] 1 test from RollingRestartArgs/RollingRestartITest
[ RUN ] RollingRestartArgs/RollingRestartITest.TestWorkloads/4
2026-04-29T19:55:09Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-04-29T19:55:09Z Disabled control of system clock
I20260429 19:55:09.819602 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.32.126:36395
--webserver_interface=127.10.32.126
--webserver_port=0
--builtin_ntp_servers=127.10.32.84:40073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.32.126:36395
--location_mapping_cmd=/tmp/dist-test-tasksFvwcp/build/asan/bin/testdata/assign-location.py --state_store=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/location-assignment.state --map /L0:4
--master_client_location_assignment_enabled=false with env {}
W20260429 19:55:10.172714 11597 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:55:10.173059 11597 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:55:10.173137 11597 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:55:10.182524 11597 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260429 19:55:10.182638 11597 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:55:10.182698 11597 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260429 19:55:10.182763 11597 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260429 19:55:10.194267 11597 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/master-0/wal
--location_mapping_cmd=/tmp/dist-test-tasksFvwcp/build/asan/bin/testdata/assign-location.py --state_store=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/location-assignment.state --map /L0:4
--ipki_ca_key_size=768
--master_addresses=127.10.32.126:36395
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.32.126:36395
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.32.126
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:55:10.196053 11597 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:55:10.197950 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260429 19:55:10.206199 11603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:10.206260 11602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:10.206655 11605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:55:10.207608 11597 server_base.cc:1061] running on GCE node
I20260429 19:55:10.208386 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 19:55:10.209990 11597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:55:10.211261 11597 hybrid_clock.cc:648] HybridClock initialized: now 1777492510211212 us; error 39 us; skew 500 ppm
I20260429 19:55:10.211628 11597 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:55:10.217272 11597 webserver.cc:492] Webserver started at http://127.10.32.126:42941/ using document root <none> and password file <none>
I20260429 19:55:10.218058 11597 fs_manager.cc:362] Metadata directory not provided
I20260429 19:55:10.218183 11597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 19:55:10.218569 11597 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260429 19:55:10.222836 11597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/master-0/data/instance:
uuid: "0f14bf238ad54462a8961c8f54f145a8"
format_stamp: "Formatted at 2026-04-29 19:55:10 on dist-test-slave-hwg5"
I20260429 19:55:10.223711 11597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/master-0/wal/instance:
uuid: "0f14bf238ad54462a8961c8f54f145a8"
format_stamp: "Formatted at 2026-04-29 19:55:10 on dist-test-slave-hwg5"
I20260429 19:55:10.230376 11597 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.003s sys 0.003s
I20260429 19:55:10.234678 11611 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:10.236397 11597 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260429 19:55:10.236596 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/master-0/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/master-0/wal
uuid: "0f14bf238ad54462a8961c8f54f145a8"
format_stamp: "Formatted at 2026-04-29 19:55:10 on dist-test-slave-hwg5"
I20260429 19:55:10.236914 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 19:55:10.256805 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:55:10.258421 11597 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:55:10.258723 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:55:10.279613 11597 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.126:36395
I20260429 19:55:10.279620 11662 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.126:36395 every 8 connection(s)
I20260429 19:55:10.281133 11597 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/master-0/data/info.pb
I20260429 19:55:10.286020 11663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:55:10.287498 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 11597
I20260429 19:55:10.287703 10369 external_mini_cluster.cc:1442] Reading /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/master-0/wal/instance
I20260429 19:55:10.297556 11663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8: Bootstrap starting.
I20260429 19:55:10.301674 11663 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8: Neither blocks nor log segments found. Creating new log.
I20260429 19:55:10.302868 11663 log.cc:826] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8: Log is configured to *not* fsync() on all Append() calls
I20260429 19:55:10.305573 11663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8: No bootstrap required, opened a new log
I20260429 19:55:10.310902 11663 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f14bf238ad54462a8961c8f54f145a8" member_type: VOTER last_known_addr { host: "127.10.32.126" port: 36395 } }
I20260429 19:55:10.311299 11663 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:55:10.311401 11663 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f14bf238ad54462a8961c8f54f145a8, State: Initialized, Role: FOLLOWER
I20260429 19:55:10.311995 11663 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f14bf238ad54462a8961c8f54f145a8" member_type: VOTER last_known_addr { host: "127.10.32.126" port: 36395 } }
I20260429 19:55:10.312213 11663 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260429 19:55:10.312338 11663 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260429 19:55:10.312512 11663 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8 [term 0 FOLLOWER]: Advancing to term 1
I20260429 19:55:10.314896 11663 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f14bf238ad54462a8961c8f54f145a8" member_type: VOTER last_known_addr { host: "127.10.32.126" port: 36395 } }
I20260429 19:55:10.315471 11663 leader_election.cc:304] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f14bf238ad54462a8961c8f54f145a8; no voters:
I20260429 19:55:10.316073 11663 leader_election.cc:290] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260429 19:55:10.316228 11668 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 19:55:10.316880 11668 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8 [term 1 LEADER]: Becoming Leader. State: Replica: 0f14bf238ad54462a8961c8f54f145a8, State: Running, Role: LEADER
I20260429 19:55:10.317466 11668 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f14bf238ad54462a8961c8f54f145a8" member_type: VOTER last_known_addr { host: "127.10.32.126" port: 36395 } }
I20260429 19:55:10.318195 11663 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260429 19:55:10.320748 11669 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f14bf238ad54462a8961c8f54f145a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f14bf238ad54462a8961c8f54f145a8" member_type: VOTER last_known_addr { host: "127.10.32.126" port: 36395 } } }
I20260429 19:55:10.321116 11669 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8 [sys.catalog]: This master's current role is: LEADER
I20260429 19:55:10.321123 11670 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f14bf238ad54462a8961c8f54f145a8. Latest consensus state: current_term: 1 leader_uuid: "0f14bf238ad54462a8961c8f54f145a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f14bf238ad54462a8961c8f54f145a8" member_type: VOTER last_known_addr { host: "127.10.32.126" port: 36395 } } }
I20260429 19:55:10.322710 11670 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8 [sys.catalog]: This master's current role is: LEADER
I20260429 19:55:10.326292 11677 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260429 19:55:10.331108 11677 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260429 19:55:10.340551 11677 catalog_manager.cc:1357] Generated new cluster ID: 8bcd6aa267694d38b5648d2fcb05691c
I20260429 19:55:10.340690 11677 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260429 19:55:10.374948 11677 catalog_manager.cc:1380] Generated new certificate authority record
I20260429 19:55:10.376946 11677 catalog_manager.cc:1514] Loading token signing keys...
I20260429 19:55:10.390623 11677 catalog_manager.cc:6044] T 00000000000000000000000000000000 P 0f14bf238ad54462a8961c8f54f145a8: Generated new TSK 0
I20260429 19:55:10.391806 11677 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260429 19:55:10.401741 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.32.65:0
--local_ip_for_outbound_sockets=127.10.32.65
--webserver_interface=127.10.32.65
--webserver_port=0
--tserver_master_addrs=127.10.32.126:36395
--builtin_ntp_servers=127.10.32.84:40073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260429 19:55:10.762749 11687 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:55:10.763162 11687 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:55:10.763298 11687 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:55:10.771965 11687 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:55:10.772181 11687 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.32.65
I20260429 19:55:10.783056 11687 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.32.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.32.65
--webserver_port=0
--tserver_master_addrs=127.10.32.126:36395
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.32.65
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:55:10.784737 11687 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:55:10.786655 11687 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260429 19:55:10.790741 11687 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260429 19:55:10.796722 11692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:10.796746 11693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:10.797474 11695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:55:10.797798 11687 server_base.cc:1061] running on GCE node
I20260429 19:55:10.798519 11687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 19:55:10.799501 11687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:55:10.800767 11687 hybrid_clock.cc:648] HybridClock initialized: now 1777492510800687 us; error 46 us; skew 500 ppm
I20260429 19:55:10.801111 11687 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:55:10.803656 11687 webserver.cc:492] Webserver started at http://127.10.32.65:33319/ using document root <none> and password file <none>
I20260429 19:55:10.804477 11687 fs_manager.cc:362] Metadata directory not provided
I20260429 19:55:10.804611 11687 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 19:55:10.804966 11687 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260429 19:55:10.807703 11687 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data/instance:
uuid: "5fd13bd23da4400b90382adbc6d22955"
format_stamp: "Formatted at 2026-04-29 19:55:10 on dist-test-slave-hwg5"
I20260429 19:55:10.808561 11687 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/wal/instance:
uuid: "5fd13bd23da4400b90382adbc6d22955"
format_stamp: "Formatted at 2026-04-29 19:55:10 on dist-test-slave-hwg5"
I20260429 19:55:10.814792 11687 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260429 19:55:10.819147 11701 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:10.820851 11687 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260429 19:55:10.821045 11687 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/wal
uuid: "5fd13bd23da4400b90382adbc6d22955"
format_stamp: "Formatted at 2026-04-29 19:55:10 on dist-test-slave-hwg5"
I20260429 19:55:10.821278 11687 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 19:55:10.869716 11687 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:55:10.870724 11687 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:55:10.871022 11687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:55:10.872080 11687 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 19:55:10.874153 11687 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260429 19:55:10.874248 11687 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:10.874405 11687 ts_tablet_manager.cc:616] Registered 0 tablets
I20260429 19:55:10.874461 11687 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260429 19:55:10.906973 11687 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.65:38215
I20260429 19:55:10.907028 11813 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.65:38215 every 8 connection(s)
I20260429 19:55:10.908394 11687 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data/info.pb
I20260429 19:55:10.914830 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 11687
I20260429 19:55:10.915040 10369 external_mini_cluster.cc:1442] Reading /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/wal/instance
I20260429 19:55:10.919462 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.32.66:0
--local_ip_for_outbound_sockets=127.10.32.66
--webserver_interface=127.10.32.66
--webserver_port=0
--tserver_master_addrs=127.10.32.126:36395
--builtin_ntp_servers=127.10.32.84:40073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260429 19:55:10.924207 11814 heartbeater.cc:344] Connected to a master server at 127.10.32.126:36395
I20260429 19:55:10.924629 11814 heartbeater.cc:461] Registering TS with master...
I20260429 19:55:10.925627 11814 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:10.973867 11628 ts_manager.cc:194] Registered new tserver with Master: 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215)
I20260429 19:55:10.976550 11628 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.32.65:32907
W20260429 19:55:11.272969 11818 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:55:11.273310 11818 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:55:11.273391 11818 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:55:11.282157 11818 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:55:11.282349 11818 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.32.66
I20260429 19:55:11.293283 11818 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.32.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.32.66
--webserver_port=0
--tserver_master_addrs=127.10.32.126:36395
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.32.66
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:55:11.294924 11818 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:55:11.296748 11818 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260429 19:55:11.300638 11818 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260429 19:55:11.307139 11824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:11.307166 11825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:11.307192 11827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:55:11.308069 11818 server_base.cc:1061] running on GCE node
I20260429 19:55:11.308697 11818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 19:55:11.309685 11818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:55:11.310938 11818 hybrid_clock.cc:648] HybridClock initialized: now 1777492511310860 us; error 47 us; skew 500 ppm
I20260429 19:55:11.311249 11818 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:55:11.313542 11818 webserver.cc:492] Webserver started at http://127.10.32.66:35497/ using document root <none> and password file <none>
I20260429 19:55:11.314302 11818 fs_manager.cc:362] Metadata directory not provided
I20260429 19:55:11.314445 11818 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 19:55:11.314781 11818 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260429 19:55:11.317243 11818 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data/instance:
uuid: "c716e625b12e48419e4855fc59197a15"
format_stamp: "Formatted at 2026-04-29 19:55:11 on dist-test-slave-hwg5"
I20260429 19:55:11.318058 11818 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/wal/instance:
uuid: "c716e625b12e48419e4855fc59197a15"
format_stamp: "Formatted at 2026-04-29 19:55:11 on dist-test-slave-hwg5"
I20260429 19:55:11.324319 11818 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260429 19:55:11.328899 11833 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:11.330688 11818 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260429 19:55:11.330876 11818 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/wal
uuid: "c716e625b12e48419e4855fc59197a15"
format_stamp: "Formatted at 2026-04-29 19:55:11 on dist-test-slave-hwg5"
I20260429 19:55:11.331043 11818 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 19:55:11.353077 11818 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:55:11.354005 11818 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:55:11.354302 11818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:55:11.355366 11818 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 19:55:11.357169 11818 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260429 19:55:11.357250 11818 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:11.357352 11818 ts_tablet_manager.cc:616] Registered 0 tablets
I20260429 19:55:11.357407 11818 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:11.391076 11818 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.66:43535
I20260429 19:55:11.391111 11945 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.66:43535 every 8 connection(s)
I20260429 19:55:11.392459 11818 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data/info.pb
I20260429 19:55:11.401824 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 11818
I20260429 19:55:11.402011 10369 external_mini_cluster.cc:1442] Reading /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/wal/instance
I20260429 19:55:11.405779 11946 heartbeater.cc:344] Connected to a master server at 127.10.32.126:36395
I20260429 19:55:11.405815 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.32.67:0
--local_ip_for_outbound_sockets=127.10.32.67
--webserver_interface=127.10.32.67
--webserver_port=0
--tserver_master_addrs=127.10.32.126:36395
--builtin_ntp_servers=127.10.32.84:40073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260429 19:55:11.406235 11946 heartbeater.cc:461] Registering TS with master...
I20260429 19:55:11.407282 11946 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:11.452265 11628 ts_manager.cc:194] Registered new tserver with Master: c716e625b12e48419e4855fc59197a15 (127.10.32.66:43535)
I20260429 19:55:11.453572 11628 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.32.66:52575
W20260429 19:55:11.752801 11949 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:55:11.753137 11949 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:55:11.753233 11949 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:55:11.761915 11949 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:55:11.762099 11949 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.32.67
I20260429 19:55:11.772604 11949 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.32.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.32.67
--webserver_port=0
--tserver_master_addrs=127.10.32.126:36395
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.32.67
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:55:11.774174 11949 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:55:11.776041 11949 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260429 19:55:11.780009 11949 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260429 19:55:11.786733 11955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:11.786350 11956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:11.786688 11958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:55:11.787367 11949 server_base.cc:1061] running on GCE node
I20260429 19:55:11.788210 11949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 19:55:11.789183 11949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:55:11.790479 11949 hybrid_clock.cc:648] HybridClock initialized: now 1777492511790376 us; error 44 us; skew 500 ppm
I20260429 19:55:11.790799 11949 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:55:11.793231 11949 webserver.cc:492] Webserver started at http://127.10.32.67:39603/ using document root <none> and password file <none>
I20260429 19:55:11.794034 11949 fs_manager.cc:362] Metadata directory not provided
I20260429 19:55:11.794148 11949 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 19:55:11.794663 11949 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260429 19:55:11.797437 11949 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data/instance:
uuid: "7c14d1f90d944ae4b2f546d620ec249c"
format_stamp: "Formatted at 2026-04-29 19:55:11 on dist-test-slave-hwg5"
I20260429 19:55:11.798259 11949 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/wal/instance:
uuid: "7c14d1f90d944ae4b2f546d620ec249c"
format_stamp: "Formatted at 2026-04-29 19:55:11 on dist-test-slave-hwg5"
I20260429 19:55:11.804463 11949 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260429 19:55:11.809160 11964 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:11.810881 11949 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260429 19:55:11.811076 11949 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/wal
uuid: "7c14d1f90d944ae4b2f546d620ec249c"
format_stamp: "Formatted at 2026-04-29 19:55:11 on dist-test-slave-hwg5"
I20260429 19:55:11.811249 11949 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 19:55:11.834455 11949 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:55:11.835335 11949 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:55:11.835605 11949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:55:11.836663 11949 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 19:55:11.838445 11949 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260429 19:55:11.838527 11949 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260429 19:55:11.838627 11949 ts_tablet_manager.cc:616] Registered 0 tablets
I20260429 19:55:11.838676 11949 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:11.872978 11949 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.67:44017
I20260429 19:55:11.873035 12076 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.67:44017 every 8 connection(s)
I20260429 19:55:11.874356 11949 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data/info.pb
I20260429 19:55:11.884253 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 11949
I20260429 19:55:11.884461 10369 external_mini_cluster.cc:1442] Reading /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/wal/instance
I20260429 19:55:11.888236 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.32.68:0
--local_ip_for_outbound_sockets=127.10.32.68
--webserver_interface=127.10.32.68
--webserver_port=0
--tserver_master_addrs=127.10.32.126:36395
--builtin_ntp_servers=127.10.32.84:40073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260429 19:55:11.888670 12077 heartbeater.cc:344] Connected to a master server at 127.10.32.126:36395
I20260429 19:55:11.889039 12077 heartbeater.cc:461] Registering TS with master...
I20260429 19:55:11.889891 12077 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:11.948154 11628 ts_manager.cc:194] Registered new tserver with Master: 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017)
I20260429 19:55:11.949111 11628 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.32.67:53763
I20260429 19:55:11.980521 11814 heartbeater.cc:499] Master 127.10.32.126:36395 was elected leader, sending a full tablet report...
W20260429 19:55:12.248168 12080 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:55:12.248517 12080 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:55:12.248597 12080 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:55:12.257614 12080 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:55:12.257840 12080 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.32.68
I20260429 19:55:12.268787 12080 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.32.68:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.10.32.68
--webserver_port=0
--tserver_master_addrs=127.10.32.126:36395
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.32.68
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:55:12.270298 12080 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:55:12.272133 12080 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260429 19:55:12.275985 12080 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260429 19:55:12.282088 12087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:12.282452 12086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:12.284425 12089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:55:12.285308 12080 server_base.cc:1061] running on GCE node
I20260429 19:55:12.285997 12080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 19:55:12.287060 12080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:55:12.288307 12080 hybrid_clock.cc:648] HybridClock initialized: now 1777492512288206 us; error 45 us; skew 500 ppm
I20260429 19:55:12.288662 12080 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:55:12.291014 12080 webserver.cc:492] Webserver started at http://127.10.32.68:37295/ using document root <none> and password file <none>
I20260429 19:55:12.291796 12080 fs_manager.cc:362] Metadata directory not provided
I20260429 19:55:12.291909 12080 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 19:55:12.292251 12080 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260429 19:55:12.294834 12080 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data/instance:
uuid: "25e23c8f6f1d4fc299d315619fcd4021"
format_stamp: "Formatted at 2026-04-29 19:55:12 on dist-test-slave-hwg5"
I20260429 19:55:12.295615 12080 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/wal/instance:
uuid: "25e23c8f6f1d4fc299d315619fcd4021"
format_stamp: "Formatted at 2026-04-29 19:55:12 on dist-test-slave-hwg5"
I20260429 19:55:12.301486 12080 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260429 19:55:12.305281 12095 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:12.306900 12080 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260429 19:55:12.307082 12080 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/wal
uuid: "25e23c8f6f1d4fc299d315619fcd4021"
format_stamp: "Formatted at 2026-04-29 19:55:12 on dist-test-slave-hwg5"
I20260429 19:55:12.307245 12080 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 19:55:12.330937 12080 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:55:12.331841 12080 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:55:12.332122 12080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:55:12.333518 12080 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 19:55:12.335549 12080 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260429 19:55:12.335651 12080 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:12.335772 12080 ts_tablet_manager.cc:616] Registered 0 tablets
I20260429 19:55:12.335834 12080 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:12.368749 12080 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.68:37785
I20260429 19:55:12.368805 12207 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.68:37785 every 8 connection(s)
I20260429 19:55:12.370146 12080 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data/info.pb
I20260429 19:55:12.371790 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 12080
I20260429 19:55:12.371966 10369 external_mini_cluster.cc:1442] Reading /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/wal/instance
I20260429 19:55:12.389449 12208 heartbeater.cc:344] Connected to a master server at 127.10.32.126:36395
I20260429 19:55:12.389858 12208 heartbeater.cc:461] Registering TS with master...
I20260429 19:55:12.390823 12208 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:12.437258 11627 ts_manager.cc:194] Registered new tserver with Master: 25e23c8f6f1d4fc299d315619fcd4021 (127.10.32.68:37785)
I20260429 19:55:12.438247 11627 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.32.68:53425
I20260429 19:55:12.440778 10369 external_mini_cluster.cc:949] 4 TS(s) registered with all masters
I20260429 19:55:12.456761 11946 heartbeater.cc:499] Master 127.10.32.126:36395 was elected leader, sending a full tablet report...
I20260429 19:55:12.475677 11627 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52968:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 19:55:12.515729 11749 tablet_service.cc:1511] Processing CreateTablet for tablet b25d2531d0c044f7b297f7f323e75414 (DEFAULT_TABLE table=test-workload [id=aa1b6026c8c24d68a6780cc485eb743a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 19:55:12.515758 11881 tablet_service.cc:1511] Processing CreateTablet for tablet b25d2531d0c044f7b297f7f323e75414 (DEFAULT_TABLE table=test-workload [id=aa1b6026c8c24d68a6780cc485eb743a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 19:55:12.517217 11881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b25d2531d0c044f7b297f7f323e75414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:55:12.517238 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b25d2531d0c044f7b297f7f323e75414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:55:12.523845 12012 tablet_service.cc:1511] Processing CreateTablet for tablet b25d2531d0c044f7b297f7f323e75414 (DEFAULT_TABLE table=test-workload [id=aa1b6026c8c24d68a6780cc485eb743a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 19:55:12.525520 12012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b25d2531d0c044f7b297f7f323e75414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 19:55:12.527614 12232 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Bootstrap starting.
I20260429 19:55:12.531164 12233 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Bootstrap starting.
I20260429 19:55:12.531967 12232 tablet_bootstrap.cc:654] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Neither blocks nor log segments found. Creating new log.
I20260429 19:55:12.533366 12232 log.cc:826] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Log is configured to *not* fsync() on all Append() calls
I20260429 19:55:12.534839 12233 tablet_bootstrap.cc:654] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Neither blocks nor log segments found. Creating new log.
I20260429 19:55:12.536229 12233 log.cc:826] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Log is configured to *not* fsync() on all Append() calls
I20260429 19:55:12.536639 12232 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: No bootstrap required, opened a new log
I20260429 19:55:12.537017 12232 ts_tablet_manager.cc:1403] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260429 19:55:12.538772 12236 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Bootstrap starting.
I20260429 19:55:12.539459 12233 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: No bootstrap required, opened a new log
I20260429 19:55:12.539803 12233 ts_tablet_manager.cc:1403] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260429 19:55:12.542505 12236 tablet_bootstrap.cc:654] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Neither blocks nor log segments found. Creating new log.
I20260429 19:55:12.543748 12236 log.cc:826] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Log is configured to *not* fsync() on all Append() calls
I20260429 19:55:12.544173 12232 raft_consensus.cc:359] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:12.544617 12232 raft_consensus.cc:385] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:55:12.544728 12232 raft_consensus.cc:740] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fd13bd23da4400b90382adbc6d22955, State: Initialized, Role: FOLLOWER
I20260429 19:55:12.545603 12232 consensus_queue.cc:260] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:12.546979 12236 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: No bootstrap required, opened a new log
I20260429 19:55:12.547271 12236 ts_tablet_manager.cc:1403] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260429 19:55:12.547286 12233 raft_consensus.cc:359] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:12.547713 12233 raft_consensus.cc:385] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:55:12.547817 12233 raft_consensus.cc:740] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716e625b12e48419e4855fc59197a15, State: Initialized, Role: FOLLOWER
I20260429 19:55:12.548574 12233 consensus_queue.cc:260] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:12.550527 12233 ts_tablet_manager.cc:1434] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Time spent starting tablet: real 0.011s user 0.009s sys 0.001s
I20260429 19:55:12.554051 12232 ts_tablet_manager.cc:1434] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Time spent starting tablet: real 0.017s user 0.003s sys 0.012s
I20260429 19:55:12.553921 12236 raft_consensus.cc:359] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:12.554598 12236 raft_consensus.cc:385] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 19:55:12.554777 12236 raft_consensus.cc:740] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c14d1f90d944ae4b2f546d620ec249c, State: Initialized, Role: FOLLOWER
I20260429 19:55:12.555804 12236 consensus_queue.cc:260] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:12.557096 12077 heartbeater.cc:499] Master 127.10.32.126:36395 was elected leader, sending a full tablet report...
I20260429 19:55:12.557893 12236 ts_tablet_manager.cc:1434] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Time spent starting tablet: real 0.011s user 0.009s sys 0.000s
I20260429 19:55:12.569675 12238 raft_consensus.cc:493] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:55:12.570014 12238 raft_consensus.cc:515] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:12.572021 12238 leader_election.cc:290] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c716e625b12e48419e4855fc59197a15 (127.10.32.66:43535), 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017)
I20260429 19:55:12.573853 12240 raft_consensus.cc:493] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:55:12.574142 12240 raft_consensus.cc:515] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:12.576359 12240 leader_election.cc:290] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c716e625b12e48419e4855fc59197a15 (127.10.32.66:43535), 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215)
I20260429 19:55:12.581264 11901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "5fd13bd23da4400b90382adbc6d22955" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716e625b12e48419e4855fc59197a15" is_pre_election: true
I20260429 19:55:12.581828 11901 raft_consensus.cc:2468] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fd13bd23da4400b90382adbc6d22955 in term 0.
I20260429 19:55:12.582190 12032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "5fd13bd23da4400b90382adbc6d22955" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c14d1f90d944ae4b2f546d620ec249c" is_pre_election: true
I20260429 19:55:12.582654 12032 raft_consensus.cc:2468] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fd13bd23da4400b90382adbc6d22955 in term 0.
I20260429 19:55:12.582621 11702 leader_election.cc:304] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fd13bd23da4400b90382adbc6d22955, c716e625b12e48419e4855fc59197a15; no voters:
I20260429 19:55:12.583027 12238 raft_consensus.cc:2804] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 19:55:12.583197 12238 raft_consensus.cc:493] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 19:55:12.583317 12238 raft_consensus.cc:3060] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 0 FOLLOWER]: Advancing to term 1
I20260429 19:55:12.586117 12238 raft_consensus.cc:515] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:12.587366 11901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "5fd13bd23da4400b90382adbc6d22955" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716e625b12e48419e4855fc59197a15"
I20260429 19:55:12.587582 11901 raft_consensus.cc:3060] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 0 FOLLOWER]: Advancing to term 1
I20260429 19:55:12.587886 12032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "5fd13bd23da4400b90382adbc6d22955" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c14d1f90d944ae4b2f546d620ec249c"
I20260429 19:55:12.588080 12032 raft_consensus.cc:3060] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 0 FOLLOWER]: Advancing to term 1
I20260429 19:55:12.590197 11900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "7c14d1f90d944ae4b2f546d620ec249c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c716e625b12e48419e4855fc59197a15" is_pre_election: true
I20260429 19:55:12.590858 11901 raft_consensus.cc:2468] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fd13bd23da4400b90382adbc6d22955 in term 1.
I20260429 19:55:12.591307 11702 leader_election.cc:304] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fd13bd23da4400b90382adbc6d22955, c716e625b12e48419e4855fc59197a15; no voters:
I20260429 19:55:12.591419 12238 leader_election.cc:290] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [CANDIDATE]: Term 1 election: Requested vote from peers c716e625b12e48419e4855fc59197a15 (127.10.32.66:43535), 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017)
I20260429 19:55:12.591812 12238 raft_consensus.cc:2804] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 19:55:12.591693 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "7c14d1f90d944ae4b2f546d620ec249c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fd13bd23da4400b90382adbc6d22955" is_pre_election: true
I20260429 19:55:12.592115 12238 raft_consensus.cc:697] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 1 LEADER]: Becoming Leader. State: Replica: 5fd13bd23da4400b90382adbc6d22955, State: Running, Role: LEADER
I20260429 19:55:12.592691 12238 consensus_queue.cc:237] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:12.596053 12032 raft_consensus.cc:2468] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fd13bd23da4400b90382adbc6d22955 in term 1.
I20260429 19:55:12.598608 11967 leader_election.cc:304] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c14d1f90d944ae4b2f546d620ec249c; no voters: 5fd13bd23da4400b90382adbc6d22955, c716e625b12e48419e4855fc59197a15
I20260429 19:55:12.599088 12240 raft_consensus.cc:2749] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260429 19:55:12.599984 11627 catalog_manager.cc:5671] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65). New cstate: current_term: 1 leader_uuid: "5fd13bd23da4400b90382adbc6d22955" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } health_report { overall_health: UNKNOWN } } }
I20260429 19:55:12.612008 10369 maintenance_mode-itest.cc:745] Restarting batch of 4 tservers: c716e625b12e48419e4855fc59197a15,7c14d1f90d944ae4b2f546d620ec249c,5fd13bd23da4400b90382adbc6d22955,25e23c8f6f1d4fc299d315619fcd4021
W20260429 19:55:12.626355 12078 tablet.cc:2404] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260429 19:55:12.644925 11947 tablet.cc:2404] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260429 19:55:12.661362 11815 tablet.cc:2404] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260429 19:55:12.690944 12238 consensus_queue.cc:1048] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 19:55:12.706895 12238 consensus_queue.cc:1048] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 19:55:12.803108 12265 mvcc.cc:204] Tried to move back new op lower bound from 7280609332374245376 to 7280609331584577536. Current Snapshot: MvccSnapshot[applied={T|T < 7280609332374245376}]
I20260429 19:55:13.441689 12208 heartbeater.cc:499] Master 127.10.32.126:36395 was elected leader, sending a full tablet report...
I20260429 19:55:13.553684 11619 ts_manager.cc:295] Set tserver state for c716e625b12e48419e4855fc59197a15 to MAINTENANCE_MODE
I20260429 19:55:13.859691 11619 ts_manager.cc:295] Set tserver state for 7c14d1f90d944ae4b2f546d620ec249c to MAINTENANCE_MODE
I20260429 19:55:14.098552 11619 ts_manager.cc:295] Set tserver state for 5fd13bd23da4400b90382adbc6d22955 to MAINTENANCE_MODE
I20260429 19:55:14.708489 11619 ts_manager.cc:295] Set tserver state for 25e23c8f6f1d4fc299d315619fcd4021 to MAINTENANCE_MODE
I20260429 19:55:15.712097 11881 tablet_service.cc:1460] Tablet server c716e625b12e48419e4855fc59197a15 set to quiescing
I20260429 19:55:15.712430 11881 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260429 19:55:15.764621 12143 tablet_service.cc:1460] Tablet server 25e23c8f6f1d4fc299d315619fcd4021 set to quiescing
I20260429 19:55:15.764940 12143 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260429 19:55:16.044317 11749 tablet_service.cc:1460] Tablet server 5fd13bd23da4400b90382adbc6d22955 set to quiescing
I20260429 19:55:16.044611 11749 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260429 19:55:16.066145 12367 raft_consensus.cc:993] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: : Instructing follower 7c14d1f90d944ae4b2f546d620ec249c to start an election
I20260429 19:55:16.066334 12367 raft_consensus.cc:1081] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 1 LEADER]: Signalling peer 7c14d1f90d944ae4b2f546d620ec249c to start an election
I20260429 19:55:16.068153 12031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414"
dest_uuid: "7c14d1f90d944ae4b2f546d620ec249c"
from {username='slave'} at 127.10.32.65:36711
I20260429 19:55:16.068440 12031 raft_consensus.cc:493] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260429 19:55:16.068579 12031 raft_consensus.cc:3060] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 1 FOLLOWER]: Advancing to term 2
I20260429 19:55:16.072347 12031 raft_consensus.cc:515] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:16.073359 12032 raft_consensus.cc:1240] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 2 FOLLOWER]: Rejecting Update request from peer 5fd13bd23da4400b90382adbc6d22955 for earlier term 1. Current term is 2. Ops: [1.150-1.150]
I20260429 19:55:16.074056 12358 consensus_queue.cc:1059] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 }, Status: INVALID_TERM, Last received: 1.149, Next index: 150, Last known committed idx: 149, Time since last communication: 0.000s
I20260429 19:55:16.074442 12358 raft_consensus.cc:3055] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 1 LEADER]: Stepping down as leader of term 1
I20260429 19:55:16.074548 12358 raft_consensus.cc:740] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5fd13bd23da4400b90382adbc6d22955, State: Running, Role: LEADER
I20260429 19:55:16.074851 12358 consensus_queue.cc:260] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 149, Committed index: 149, Last appended: 1.150, Last appended by leader: 150, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:16.075167 12358 raft_consensus.cc:3060] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 1 FOLLOWER]: Advancing to term 2
I20260429 19:55:16.079655 11900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "7c14d1f90d944ae4b2f546d620ec249c" candidate_term: 2 candidate_status { last_received { term: 1 index: 149 } } ignore_live_leader: true dest_uuid: "c716e625b12e48419e4855fc59197a15"
I20260429 19:55:16.079900 11900 raft_consensus.cc:3060] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 1 FOLLOWER]: Advancing to term 2
I20260429 19:55:16.080149 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "7c14d1f90d944ae4b2f546d620ec249c" candidate_term: 2 candidate_status { last_received { term: 1 index: 149 } } ignore_live_leader: true dest_uuid: "5fd13bd23da4400b90382adbc6d22955"
I20260429 19:55:16.080430 11769 raft_consensus.cc:2410] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c14d1f90d944ae4b2f546d620ec249c for term 2 because replica has last-logged OpId of term: 1 index: 150, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 149.
I20260429 19:55:16.080976 12031 leader_election.cc:290] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [CANDIDATE]: Term 2 election: Requested vote from peers c716e625b12e48419e4855fc59197a15 (127.10.32.66:43535), 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215)
I20260429 19:55:16.084614 11900 raft_consensus.cc:2410] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c14d1f90d944ae4b2f546d620ec249c for term 2 because replica has last-logged OpId of term: 1 index: 150, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 149.
I20260429 19:55:16.085286 11965 leader_election.cc:304] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c14d1f90d944ae4b2f546d620ec249c; no voters: 5fd13bd23da4400b90382adbc6d22955, c716e625b12e48419e4855fc59197a15
W20260429 19:55:16.096480 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
I20260429 19:55:16.119565 12379 raft_consensus.cc:2749] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260429 19:55:16.134594 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.134553 11861 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.132696 11965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.32.66:43535, user_credentials={real_user=slave}} blocked reactor thread for 47444.4us
W20260429 19:55:16.139911 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.144029 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.145610 11992 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.153319 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.155040 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.161130 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.162878 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.173583 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.175150 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.187049 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.190692 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.199970 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.203441 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.212023 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.214735 11990 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
I20260429 19:55:16.221222 12012 tablet_service.cc:1460] Tablet server 7c14d1f90d944ae4b2f546d620ec249c set to quiescing
I20260429 19:55:16.221467 12012 tablet_service.cc:1467] Tablet server has 0 leaders and 1 scanners
W20260429 19:55:16.226980 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.231026 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.242167 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.245467 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.258786 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.262495 11990 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.276360 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.280020 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.293936 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.297102 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.315099 11990 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.315141 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.333513 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.337347 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.355664 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.357705 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.375319 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.375285 12392 raft_consensus.cc:670] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: failed to trigger leader election: Illegal state: leader elections are disabled
W20260429 19:55:16.380956 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.398818 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.405053 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.423389 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.426651 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.440727 12300 raft_consensus.cc:670] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: failed to trigger leader election: Illegal state: leader elections are disabled
W20260429 19:55:16.445814 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.452723 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.458233 12379 raft_consensus.cc:670] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: failed to trigger leader election: Illegal state: leader elections are disabled
W20260429 19:55:16.470813 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.480342 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.496071 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.505223 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.522724 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.535238 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.552130 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.566807 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.582144 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.594759 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.611120 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.626322 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.646273 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.661993 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.677210 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.696758 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.709126 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.730150 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.745090 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.767832 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.780085 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.801680 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.817739 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.837807 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.858870 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.880117 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.895737 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.918882 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:16.934286 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.958669 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:16.975931 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.000279 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.019601 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.044165 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.061509 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:17.086766 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:17.108752 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.130311 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.152638 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.176318 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.198745 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:17.222944 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:17.245899 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.270841 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.294301 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.318738 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.343647 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:17.365520 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:17.393987 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.419580 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.448200 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.471748 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.503185 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:17.525338 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:17.556905 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.581794 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.608723 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.637035 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
I20260429 19:55:17.646189 11749 tablet_service.cc:1460] Tablet server 5fd13bd23da4400b90382adbc6d22955 set to quiescing
I20260429 19:55:17.646489 11749 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260429 19:55:17.664467 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:17.690697 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:17.719980 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
I20260429 19:55:17.728662 12012 tablet_service.cc:1460] Tablet server 7c14d1f90d944ae4b2f546d620ec249c set to quiescing
I20260429 19:55:17.728881 12012 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260429 19:55:17.747208 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.774684 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.803118 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.831465 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:17.861862 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
I20260429 19:55:17.864725 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 11818
I20260429 19:55:17.872536 11941 generic_service.cc:196] Checking for leaks (request via RPC)
W20260429 19:55:17.894177 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.920382 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:17.984027 11860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
I20260429 19:55:17.984103 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 11818
W20260429 19:55:17.984027 11861 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59404: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:18.000615 12217 meta_cache.cc:302] tablet b25d2531d0c044f7b297f7f323e75414: replica c716e625b12e48419e4855fc59197a15 (127.10.32.66:43535) has failed: Network error: recv got EOF from 127.10.32.66:43535 (error 108)
I20260429 19:55:18.001761 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.32.66:43535
--local_ip_for_outbound_sockets=127.10.32.66
--tserver_master_addrs=127.10.32.126:36395
--webserver_port=35497
--webserver_interface=127.10.32.66
--builtin_ntp_servers=127.10.32.84:40073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260429 19:55:18.058790 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:18.062902 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:18.120239 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:18.184669 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:18.189739 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:18.252043 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:18.311717 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:18.370771 12420 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:55:18.371105 12420 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:55:18.371240 12420 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:55:18.376101 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:18.380955 12420 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:55:18.381166 12420 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.32.66
W20260429 19:55:18.385097 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
I20260429 19:55:18.392289 12420 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.32.66:43535
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.32.66
--webserver_port=35497
--tserver_master_addrs=127.10.32.126:36395
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.32.66
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:55:18.393831 12420 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:55:18.395684 12420 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260429 19:55:18.399448 12420 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260429 19:55:18.405758 12426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:18.405786 12427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:18.406126 12429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:55:18.407102 12420 server_base.cc:1061] running on GCE node
I20260429 19:55:18.407745 12420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 19:55:18.408701 12420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:55:18.409925 12420 hybrid_clock.cc:648] HybridClock initialized: now 1777492518409852 us; error 48 us; skew 500 ppm
I20260429 19:55:18.410243 12420 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:55:18.412532 12420 webserver.cc:492] Webserver started at http://127.10.32.66:35497/ using document root <none> and password file <none>
I20260429 19:55:18.413390 12420 fs_manager.cc:362] Metadata directory not provided
I20260429 19:55:18.413537 12420 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 19:55:18.419523 12420 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260429 19:55:18.422708 12435 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:18.424201 12420 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260429 19:55:18.424408 12420 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/wal
uuid: "c716e625b12e48419e4855fc59197a15"
format_stamp: "Formatted at 2026-04-29 19:55:11 on dist-test-slave-hwg5"
I20260429 19:55:18.425143 12420 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260429 19:55:18.449357 11989 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34260: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
I20260429 19:55:18.453881 12420 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:55:18.454835 12420 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:55:18.455102 12420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:55:18.456198 12420 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 19:55:18.458606 12442 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260429 19:55:18.464919 12420 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260429 19:55:18.465080 12420 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260429 19:55:18.465214 12420 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260429 19:55:18.468582 12420 ts_tablet_manager.cc:616] Registered 1 tablets
I20260429 19:55:18.468681 12420 ts_tablet_manager.cc:595] Time spent register tablets: real 0.003s user 0.002s sys 0.000s
I20260429 19:55:18.469213 12442 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Bootstrap starting.
W20260429 19:55:18.508651 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
I20260429 19:55:18.515781 12420 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.66:43535
I20260429 19:55:18.515801 12548 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.66:43535 every 8 connection(s)
I20260429 19:55:18.517928 12420 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data/info.pb
I20260429 19:55:18.522305 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 12420
I20260429 19:55:18.522603 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 11949
I20260429 19:55:18.543671 12072 generic_service.cc:196] Checking for leaks (request via RPC)
I20260429 19:55:18.548441 12550 heartbeater.cc:344] Connected to a master server at 127.10.32.126:36395
I20260429 19:55:18.548892 12550 heartbeater.cc:461] Registering TS with master...
I20260429 19:55:18.550129 12550 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:18.553984 11623 ts_manager.cc:194] Re-registered known tserver with Master: c716e625b12e48419e4855fc59197a15 (127.10.32.66:43535)
I20260429 19:55:18.555661 11623 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.32.66:57119
I20260429 19:55:18.567931 12442 log.cc:826] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Log is configured to *not* fsync() on all Append() calls
W20260429 19:55:18.608662 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
I20260429 19:55:18.685737 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 11949
I20260429 19:55:18.716223 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.32.67:44017
--local_ip_for_outbound_sockets=127.10.32.67
--tserver_master_addrs=127.10.32.126:36395
--webserver_port=39603
--webserver_interface=127.10.32.67
--builtin_ntp_servers=127.10.32.84:40073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260429 19:55:18.729671 12253 meta_cache.cc:1510] marking tablet server 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017) as failed
W20260429 19:55:18.787919 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
I20260429 19:55:18.789323 12252 meta_cache.cc:1510] marking tablet server 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017) as failed
W20260429 19:55:18.860169 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
I20260429 19:55:18.907996 12251 meta_cache.cc:1510] marking tablet server 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017) as failed
W20260429 19:55:18.935209 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
I20260429 19:55:18.962752 12442 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Bootstrap replayed 1/1 log segments. Stats: ops{read=150 overwritten=0 applied=149 ignored=0} inserts{seen=7400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260429 19:55:18.963356 12442 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Bootstrap complete.
I20260429 19:55:18.964455 12442 ts_tablet_manager.cc:1403] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Time spent bootstrapping tablet: real 0.496s user 0.423s sys 0.052s
I20260429 19:55:18.969502 12442 raft_consensus.cc:359] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:18.972324 12442 raft_consensus.cc:740] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716e625b12e48419e4855fc59197a15, State: Initialized, Role: FOLLOWER
I20260429 19:55:18.973153 12442 consensus_queue.cc:260] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 149, Last appended: 1.150, Last appended by leader: 150, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:18.974373 12550 heartbeater.cc:499] Master 127.10.32.126:36395 was elected leader, sending a full tablet report...
I20260429 19:55:18.974905 12442 ts_tablet_manager.cc:1434] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Time spent starting tablet: real 0.010s user 0.012s sys 0.000s
W20260429 19:55:19.004293 12217 meta_cache.cc:302] tablet b25d2531d0c044f7b297f7f323e75414: replica 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017) has failed: Network error: Client connection negotiation failed: client connection to 127.10.32.67:44017: connect: Connection refused (error 111)
W20260429 19:55:19.011935 12464 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:19.082584 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:19.101274 12558 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:55:19.101617 12558 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:55:19.101701 12558 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:55:19.110992 12558 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:55:19.111220 12558 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.32.67
I20260429 19:55:19.122015 12558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.32.67:44017
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.32.67
--webserver_port=39603
--tserver_master_addrs=127.10.32.126:36395
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.32.67
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:55:19.123687 12558 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:55:19.125576 12558 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260429 19:55:19.130093 12558 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260429 19:55:19.136085 12566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:19.136083 12565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:19.136512 12568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:55:19.137645 12558 server_base.cc:1061] running on GCE node
I20260429 19:55:19.138357 12558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 19:55:19.139438 12558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:55:19.140702 12558 hybrid_clock.cc:648] HybridClock initialized: now 1777492519140610 us; error 60 us; skew 500 ppm
I20260429 19:55:19.141048 12558 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:55:19.143617 12558 webserver.cc:492] Webserver started at http://127.10.32.67:39603/ using document root <none> and password file <none>
I20260429 19:55:19.144435 12558 fs_manager.cc:362] Metadata directory not provided
I20260429 19:55:19.144567 12558 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 19:55:19.150460 12558 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260429 19:55:19.153859 12574 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:19.155514 12558 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260429 19:55:19.155700 12558 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/wal
uuid: "7c14d1f90d944ae4b2f546d620ec249c"
format_stamp: "Formatted at 2026-04-29 19:55:11 on dist-test-slave-hwg5"
I20260429 19:55:19.156654 12558 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260429 19:55:19.156905 12464 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:19.160475 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
I20260429 19:55:19.176791 12558 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:55:19.177721 12558 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:55:19.177989 12558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:55:19.179062 12558 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 19:55:19.181457 12581 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260429 19:55:19.188050 12558 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260429 19:55:19.188206 12558 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260429 19:55:19.188340 12558 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260429 19:55:19.191429 12558 ts_tablet_manager.cc:616] Registered 1 tablets
I20260429 19:55:19.191534 12558 ts_tablet_manager.cc:595] Time spent register tablets: real 0.003s user 0.002s sys 0.000s
I20260429 19:55:19.191996 12581 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Bootstrap starting.
I20260429 19:55:19.235520 12558 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.67:44017
I20260429 19:55:19.235532 12687 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.67:44017 every 8 connection(s)
I20260429 19:55:19.237552 12558 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data/info.pb
W20260429 19:55:19.238837 12464 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
I20260429 19:55:19.240096 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 12558
I20260429 19:55:19.240312 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 11687
I20260429 19:55:19.255210 11809 generic_service.cc:196] Checking for leaks (request via RPC)
I20260429 19:55:19.255668 12688 heartbeater.cc:344] Connected to a master server at 127.10.32.126:36395
I20260429 19:55:19.256112 12688 heartbeater.cc:461] Registering TS with master...
I20260429 19:55:19.257351 12688 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:19.257895 12560 raft_consensus.cc:493] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:55:19.258140 12560 raft_consensus.cc:515] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:19.260214 12560 leader_election.cc:290] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215), 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017)
I20260429 19:55:19.261974 11623 ts_manager.cc:194] Re-registered known tserver with Master: 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017)
I20260429 19:55:19.263825 11623 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.32.67:45663
I20260429 19:55:19.269683 12581 log.cc:826] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Log is configured to *not* fsync() on all Append() calls
I20260429 19:55:19.286748 12643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "c716e625b12e48419e4855fc59197a15" candidate_term: 3 candidate_status { last_received { term: 1 index: 150 } } ignore_live_leader: false dest_uuid: "7c14d1f90d944ae4b2f546d620ec249c" is_pre_election: true
W20260429 19:55:19.292089 12436 leader_election.cc:343] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017): Illegal state: must be running to vote when last-logged opid is not known
W20260429 19:55:19.387480 11728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42594: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
I20260429 19:55:19.387895 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 11687
W20260429 19:55:19.413560 12219 connection.cc:570] client connection to 127.10.32.65:38215 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260429 19:55:19.414923 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.32.65:38215
--local_ip_for_outbound_sockets=127.10.32.65
--tserver_master_addrs=127.10.32.126:36395
--webserver_port=33319
--webserver_interface=127.10.32.65
--builtin_ntp_servers=127.10.32.84:40073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260429 19:55:19.415035 12696 negotiation.cc:336] Failed RPC negotiation. Trace:
0429 19:55:19.260723 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.10.32.65:38215 (local address 127.10.32.66:39277)
0429 19:55:19.275980 (+ 15257us) negotiation.cc:107] Waiting for socket to connect
0429 19:55:19.276007 (+ 27us) client_negotiation.cc:175] Beginning negotiation
0429 19:55:19.276293 (+ 286us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0429 19:55:19.387243 (+110950us) client_negotiation.cc:272] Received NEGOTIATE NegotiatePB response
0429 19:55:19.387250 (+ 7us) client_negotiation.cc:395] Received NEGOTIATE response from server
0429 19:55:19.387303 (+ 53us) client_negotiation.cc:190] Negotiated authn=CERTIFICATE
0429 19:55:19.387982 (+ 679us) client_negotiation.cc:515] Sending TLS_HANDSHAKE message to server
0429 19:55:19.387999 (+ 17us) client_negotiation.cc:253] Sending TLS_HANDSHAKE NegotiatePB request
0429 19:55:19.413665 (+ 25666us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.32.65:38215: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":15122,"thread_start_us":14739,"threads_started":1}
W20260429 19:55:19.415369 12438 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.32.65:38215: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260429 19:55:19.417151 12438 leader_election.cc:336] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215): Network error: Client connection negotiation failed: client connection to 127.10.32.65:38215: connect: Connection refused (error 111)
I20260429 19:55:19.417325 12438 leader_election.cc:304] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c716e625b12e48419e4855fc59197a15; no voters: 5fd13bd23da4400b90382adbc6d22955, 7c14d1f90d944ae4b2f546d620ec249c
I20260429 19:55:19.418051 12560 raft_consensus.cc:2749] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260429 19:55:19.494419 12464 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:19.494441 12463 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:19.737231 12463 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:19.741415 12463 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
I20260429 19:55:19.744154 12581 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Bootstrap replayed 1/1 log segments. Stats: ops{read=149 overwritten=0 applied=149 ignored=0} inserts{seen=7400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260429 19:55:19.744733 12581 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Bootstrap complete.
I20260429 19:55:19.745903 12581 ts_tablet_manager.cc:1403] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Time spent bootstrapping tablet: real 0.554s user 0.482s sys 0.068s
I20260429 19:55:19.748587 12581 raft_consensus.cc:359] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:19.749285 12581 raft_consensus.cc:740] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c14d1f90d944ae4b2f546d620ec249c, State: Initialized, Role: FOLLOWER
I20260429 19:55:19.749902 12581 consensus_queue.cc:260] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 149, Last appended: 1.149, Last appended by leader: 149, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:19.750969 12688 heartbeater.cc:499] Master 127.10.32.126:36395 was elected leader, sending a full tablet report...
I20260429 19:55:19.751538 12581 ts_tablet_manager.cc:1434] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Time spent starting tablet: real 0.006s user 0.001s sys 0.004s
I20260429 19:55:19.813687 12560 raft_consensus.cc:493] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:55:19.813901 12560 raft_consensus.cc:515] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:19.814721 12560 leader_election.cc:290] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215), 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017)
I20260429 19:55:19.815353 12643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "c716e625b12e48419e4855fc59197a15" candidate_term: 3 candidate_status { last_received { term: 1 index: 150 } } ignore_live_leader: false dest_uuid: "7c14d1f90d944ae4b2f546d620ec249c" is_pre_election: true
I20260429 19:55:19.815780 12643 raft_consensus.cc:2468] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c716e625b12e48419e4855fc59197a15 in term 2.
W20260429 19:55:19.816143 12438 leader_election.cc:336] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215): Network error: Client connection negotiation failed: client connection to 127.10.32.65:38215: connect: Connection refused (error 111)
I20260429 19:55:19.816403 12436 leader_election.cc:304] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c14d1f90d944ae4b2f546d620ec249c, c716e625b12e48419e4855fc59197a15; no voters: 5fd13bd23da4400b90382adbc6d22955
I20260429 19:55:19.816736 12560 raft_consensus.cc:2804] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260429 19:55:19.816865 12560 raft_consensus.cc:493] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 19:55:19.816965 12560 raft_consensus.cc:3060] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 2 FOLLOWER]: Advancing to term 3
I20260429 19:55:19.820724 12560 raft_consensus.cc:515] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:19.821434 12560 leader_election.cc:290] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 3 election: Requested vote from peers 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215), 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017)
W20260429 19:55:19.822853 12438 leader_election.cc:336] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215): Network error: Client connection negotiation failed: client connection to 127.10.32.65:38215: connect: Connection refused (error 111)
W20260429 19:55:19.823693 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
I20260429 19:55:19.823771 12643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "c716e625b12e48419e4855fc59197a15" candidate_term: 3 candidate_status { last_received { term: 1 index: 150 } } ignore_live_leader: false dest_uuid: "7c14d1f90d944ae4b2f546d620ec249c"
I20260429 19:55:19.823993 12643 raft_consensus.cc:3060] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 2 FOLLOWER]: Advancing to term 3
W20260429 19:55:19.826980 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
I20260429 19:55:19.828996 12643 raft_consensus.cc:2468] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716e625b12e48419e4855fc59197a15 in term 3.
I20260429 19:55:19.829707 12436 leader_election.cc:304] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c14d1f90d944ae4b2f546d620ec249c, c716e625b12e48419e4855fc59197a15; no voters: 5fd13bd23da4400b90382adbc6d22955
I20260429 19:55:19.830051 12560 raft_consensus.cc:2804] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 3 FOLLOWER]: Leader election won for term 3
I20260429 19:55:19.830503 12560 raft_consensus.cc:697] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 3 LEADER]: Becoming Leader. State: Replica: c716e625b12e48419e4855fc59197a15, State: Running, Role: LEADER
I20260429 19:55:19.831017 12560 consensus_queue.cc:237] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 149, Committed index: 149, Last appended: 1.150, Last appended by leader: 150, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:19.835947 11623 catalog_manager.cc:5671] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 reported cstate change: term changed from 1 to 3, leader changed from 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65) to c716e625b12e48419e4855fc59197a15 (127.10.32.66). New cstate: current_term: 3 leader_uuid: "c716e625b12e48419e4855fc59197a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } health_report { overall_health: UNKNOWN } } }
W20260429 19:55:19.838124 12700 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:55:19.838537 12700 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:55:19.838665 12700 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:55:19.849856 12700 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:55:19.850101 12700 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.32.65
I20260429 19:55:19.862072 12700 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.32.65:38215
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.32.65
--webserver_port=33319
--tserver_master_addrs=127.10.32.126:36395
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.32.65
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:55:19.864121 12700 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:55:19.866092 12700 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260429 19:55:19.870204 12700 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260429 19:55:19.876681 12713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:19.876710 12712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:19.877488 12715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:55:19.877761 12700 server_base.cc:1061] running on GCE node
I20260429 19:55:19.878530 12700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 19:55:19.879546 12700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:55:19.880815 12700 hybrid_clock.cc:648] HybridClock initialized: now 1777492519880739 us; error 46 us; skew 500 ppm
I20260429 19:55:19.881174 12700 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:55:19.883764 12700 webserver.cc:492] Webserver started at http://127.10.32.65:33319/ using document root <none> and password file <none>
I20260429 19:55:19.884912 12700 fs_manager.cc:362] Metadata directory not provided
I20260429 19:55:19.885176 12700 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 19:55:19.892165 12700 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260429 19:55:19.896188 12721 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:19.898329 12700 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260429 19:55:19.898605 12700 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/wal
uuid: "5fd13bd23da4400b90382adbc6d22955"
format_stamp: "Formatted at 2026-04-29 19:55:10 on dist-test-slave-hwg5"
I20260429 19:55:19.899376 12700 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 19:55:19.912866 12643 raft_consensus.cc:1275] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 3 FOLLOWER]: Refusing update from remote peer c716e625b12e48419e4855fc59197a15: Log matching property violated. Preceding OpId in replica: term: 1 index: 149. Preceding OpId from leader: term: 3 index: 152. (index mismatch)
W20260429 19:55:19.913061 12438 consensus_peers.cc:597] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 -> Peer 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215): Couldn't send request to peer 5fd13bd23da4400b90382adbc6d22955. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:38215: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260429 19:55:19.913841 12705 consensus_queue.cc:1048] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 151, Last known committed idx: 149, Time since last communication: 0.000s
I20260429 19:55:19.921600 12726 mvcc.cc:204] Tried to move back new op lower bound from 7280609361552932864 to 7280609361231437824. Current Snapshot: MvccSnapshot[applied={T|T < 7280609345810370560}]
I20260429 19:55:19.930593 12700 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:55:19.931905 12700 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:55:19.932188 12700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:55:19.941890 12700 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 19:55:19.954525 12734 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260429 19:55:19.962085 12700 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260429 19:55:19.962332 12700 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.018s user 0.007s sys 0.004s
I20260429 19:55:19.962565 12700 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260429 19:55:19.967036 12700 ts_tablet_manager.cc:616] Registered 1 tablets
I20260429 19:55:19.967216 12700 ts_tablet_manager.cc:595] Time spent register tablets: real 0.005s user 0.005s sys 0.000s
I20260429 19:55:19.968086 12734 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Bootstrap starting.
I20260429 19:55:20.069653 12734 log.cc:826] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Log is configured to *not* fsync() on all Append() calls
W20260429 19:55:20.081049 12219 meta_cache.cc:302] tablet b25d2531d0c044f7b297f7f323e75414: replica 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215) has failed: Network error: Client connection negotiation failed: client connection to 127.10.32.65:38215: connect: Connection refused (error 111)
W20260429 19:55:20.361730 12253 scanner-internal.cc:458] Time spent opening tablet: real 4.060s user 0.010s sys 0.002s
W20260429 19:55:20.435199 12438 consensus_peers.cc:597] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 -> Peer 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215): Couldn't send request to peer 5fd13bd23da4400b90382adbc6d22955. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:38215: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260429 19:55:20.460729 12252 scanner-internal.cc:458] Time spent opening tablet: real 4.091s user 0.007s sys 0.000s
W20260429 19:55:20.567504 12251 scanner-internal.cc:458] Time spent opening tablet: real 4.075s user 0.005s sys 0.003s
I20260429 19:55:20.785741 12734 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Bootstrap replayed 1/1 log segments. Stats: ops{read=150 overwritten=0 applied=149 ignored=0} inserts{seen=7400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260429 19:55:20.786752 12734 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Bootstrap complete.
I20260429 19:55:20.788673 12734 ts_tablet_manager.cc:1403] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Time spent bootstrapping tablet: real 0.821s user 0.671s sys 0.082s
I20260429 19:55:20.797704 12734 raft_consensus.cc:359] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:20.809484 12734 raft_consensus.cc:740] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fd13bd23da4400b90382adbc6d22955, State: Initialized, Role: FOLLOWER
I20260429 19:55:20.810850 12734 consensus_queue.cc:260] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 149, Last appended: 1.150, Last appended by leader: 150, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:20.819511 12734 ts_tablet_manager.cc:1434] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Time spent starting tablet: real 0.031s user 0.019s sys 0.008s
W20260429 19:55:20.990908 12438 consensus_peers.cc:597] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 -> Peer 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215): Couldn't send request to peer 5fd13bd23da4400b90382adbc6d22955. Status: Network error: Client connection negotiation failed: client connection to 127.10.32.65:38215: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260429 19:55:21.050835 12836 raft_consensus.cc:493] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:55:21.051179 12836 raft_consensus.cc:515] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:21.054244 12836 leader_election.cc:290] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c716e625b12e48419e4855fc59197a15 (127.10.32.66:43535), 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017)
I20260429 19:55:21.165464 12855 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.65:38215 every 8 connection(s)
I20260429 19:55:21.165876 12700 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.65:38215
I20260429 19:55:21.167972 12700 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data/info.pb
I20260429 19:55:21.178105 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 12700
I20260429 19:55:21.178360 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 12080
I20260429 19:55:21.234910 12504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "5fd13bd23da4400b90382adbc6d22955" candidate_term: 3 candidate_status { last_received { term: 1 index: 150 } } ignore_live_leader: false dest_uuid: "c716e625b12e48419e4855fc59197a15" is_pre_election: true
I20260429 19:55:21.248426 12643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "5fd13bd23da4400b90382adbc6d22955" candidate_term: 3 candidate_status { last_received { term: 1 index: 150 } } ignore_live_leader: false dest_uuid: "7c14d1f90d944ae4b2f546d620ec249c" is_pre_election: true
I20260429 19:55:21.250748 12856 heartbeater.cc:344] Connected to a master server at 127.10.32.126:36395
I20260429 19:55:21.251225 12856 heartbeater.cc:461] Registering TS with master...
I20260429 19:55:21.251276 12722 leader_election.cc:304] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5fd13bd23da4400b90382adbc6d22955; no voters: 7c14d1f90d944ae4b2f546d620ec249c, c716e625b12e48419e4855fc59197a15
I20260429 19:55:21.252480 12856 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:21.254527 12836 raft_consensus.cc:2749] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260429 19:55:21.256280 11621 ts_manager.cc:194] Re-registered known tserver with Master: 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215)
I20260429 19:55:21.258031 11621 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.32.65:47995
I20260429 19:55:21.279521 12800 raft_consensus.cc:3060] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 2 FOLLOWER]: Advancing to term 3
I20260429 19:55:21.285422 12856 heartbeater.cc:499] Master 127.10.32.126:36395 was elected leader, sending a full tablet report...
I20260429 19:55:21.290750 12203 generic_service.cc:196] Checking for leaks (request via RPC)
I20260429 19:55:21.527033 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 12080
W20260429 19:55:21.574652 11613 connection.cc:570] server connection from 127.10.32.68:53425 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260429 19:55:21.575650 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.32.68:37785
--local_ip_for_outbound_sockets=127.10.32.68
--tserver_master_addrs=127.10.32.126:36395
--webserver_port=37295
--webserver_interface=127.10.32.68
--builtin_ntp_servers=127.10.32.84:40073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260429 19:55:21.619318 12865 mvcc.cc:204] Tried to move back new op lower bound from 7280609366668099584 to 7280609361231437824. Current Snapshot: MvccSnapshot[applied={T|T < 7280609364182630400 or (T in {7280609364619104256,7280609364444024832,7280609364755333120,7280609364842471424,7280609364892303360,7280609364960821248,7280609365102137344,7280609364667506688,7280609365265285120,7280609365376507904,7280609365432864768,7280609365464612864,7280609365470343168,7280609365658275840})}]
W20260429 19:55:22.459684 12872 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:55:22.460224 12872 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:55:22.460417 12872 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:55:22.474612 12872 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:55:22.474954 12872 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.32.68
I20260429 19:55:22.498996 12872 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.32.68:37785
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.10.32.68
--webserver_port=37295
--tserver_master_addrs=127.10.32.126:36395
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.32.68
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:55:22.501633 12872 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:55:22.506448 12872 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260429 19:55:22.518101 12872 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260429 19:55:22.606103 12879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:22.606065 12880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:22.608067 12882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:55:22.613835 12872 server_base.cc:1061] running on GCE node
I20260429 19:55:22.614975 12872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 19:55:22.616291 12872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:55:22.618518 12872 hybrid_clock.cc:648] HybridClock initialized: now 1777492522618384 us; error 109 us; skew 500 ppm
I20260429 19:55:22.619009 12872 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:55:22.627624 12872 webserver.cc:492] Webserver started at http://127.10.32.68:37295/ using document root <none> and password file <none>
I20260429 19:55:22.628929 12872 fs_manager.cc:362] Metadata directory not provided
I20260429 19:55:22.629320 12872 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 19:55:22.639336 12872 fs_manager.cc:714] Time spent opening directory manager: real 0.007s user 0.006s sys 0.000s
I20260429 19:55:22.650756 12888 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:22.654758 12872 fs_manager.cc:730] Time spent opening block manager: real 0.013s user 0.004s sys 0.000s
I20260429 19:55:22.655081 12872 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/wal
uuid: "25e23c8f6f1d4fc299d315619fcd4021"
format_stamp: "Formatted at 2026-04-29 19:55:12 on dist-test-slave-hwg5"
I20260429 19:55:22.656208 12872 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 19:55:22.721351 12872 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:55:22.722648 12872 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:55:22.723033 12872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:55:22.728905 12872 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 19:55:22.737561 12872 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260429 19:55:22.737793 12872 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260429 19:55:22.737973 12872 ts_tablet_manager.cc:616] Registered 0 tablets
I20260429 19:55:22.738101 12872 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:23.796571 12872 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.68:37785
I20260429 19:55:23.796602 13004 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.68:37785 every 8 connection(s)
I20260429 19:55:23.798611 12872 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data/info.pb
I20260429 19:55:23.800664 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 12872
I20260429 19:55:23.837833 13005 heartbeater.cc:344] Connected to a master server at 127.10.32.126:36395
I20260429 19:55:23.838346 13005 heartbeater.cc:461] Registering TS with master...
I20260429 19:55:23.839615 13005 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:23.842430 11621 ts_manager.cc:194] Re-registered known tserver with Master: 25e23c8f6f1d4fc299d315619fcd4021 (127.10.32.68:37785)
I20260429 19:55:23.843484 11621 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.32.68:47071
I20260429 19:55:24.848548 13005 heartbeater.cc:499] Master 127.10.32.126:36395 was elected leader, sending a full tablet report...
I20260429 19:55:25.282850 12938 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260429 19:55:25.298372 12780 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260429 19:55:25.352106 12623 tablet_service.cc:1467] Tablet server has 0 leaders and 3 scanners
I20260429 19:55:25.364053 12484 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260429 19:55:26.993230 11625 ts_manager.cc:284] Unset tserver state for c716e625b12e48419e4855fc59197a15 from MAINTENANCE_MODE
I20260429 19:55:26.994541 12688 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:27.144162 11621 ts_manager.cc:284] Unset tserver state for 25e23c8f6f1d4fc299d315619fcd4021 from MAINTENANCE_MODE
I20260429 19:55:27.175398 11621 ts_manager.cc:284] Unset tserver state for 7c14d1f90d944ae4b2f546d620ec249c from MAINTENANCE_MODE
I20260429 19:55:27.517599 12856 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:27.559959 12550 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:27.856658 13005 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:27.997375 11621 ts_manager.cc:284] Unset tserver state for 5fd13bd23da4400b90382adbc6d22955 from MAINTENANCE_MODE
I20260429 19:55:27.999753 12688 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:28.522641 12856 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:28.565176 12550 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:28.860899 13005 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:29.475205 11621 ts_manager.cc:295] Set tserver state for 5fd13bd23da4400b90382adbc6d22955 to MAINTENANCE_MODE
I20260429 19:55:29.779732 11621 ts_manager.cc:295] Set tserver state for c716e625b12e48419e4855fc59197a15 to MAINTENANCE_MODE
I20260429 19:55:30.002475 11621 ts_manager.cc:295] Set tserver state for 7c14d1f90d944ae4b2f546d620ec249c to MAINTENANCE_MODE
I20260429 19:55:30.692545 11621 ts_manager.cc:295] Set tserver state for 25e23c8f6f1d4fc299d315619fcd4021 to MAINTENANCE_MODE
I20260429 19:55:32.038069 12938 tablet_service.cc:1460] Tablet server 25e23c8f6f1d4fc299d315619fcd4021 set to quiescing
I20260429 19:55:32.038339 12938 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260429 19:55:32.313947 12780 tablet_service.cc:1460] Tablet server 5fd13bd23da4400b90382adbc6d22955 set to quiescing
I20260429 19:55:32.314244 12780 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260429 19:55:32.744642 12484 tablet_service.cc:1460] Tablet server c716e625b12e48419e4855fc59197a15 set to quiescing
I20260429 19:55:32.744894 12484 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260429 19:55:32.757121 13210 raft_consensus.cc:993] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: : Instructing follower 7c14d1f90d944ae4b2f546d620ec249c to start an election
I20260429 19:55:32.757449 13178 raft_consensus.cc:1081] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 3 LEADER]: Signalling peer 7c14d1f90d944ae4b2f546d620ec249c to start an election
I20260429 19:55:32.758595 12642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414"
dest_uuid: "7c14d1f90d944ae4b2f546d620ec249c"
from {username='slave'} at 127.10.32.66:43977
I20260429 19:55:32.758829 12642 raft_consensus.cc:493] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260429 19:55:32.758930 12642 raft_consensus.cc:3060] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 3 FOLLOWER]: Advancing to term 4
I20260429 19:55:32.761797 12642 raft_consensus.cc:515] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:32.763522 12643 raft_consensus.cc:1240] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 4 FOLLOWER]: Rejecting Update request from peer c716e625b12e48419e4855fc59197a15 for earlier term 3. Current term is 4. Ops: []
I20260429 19:55:32.764132 13116 consensus_queue.cc:1059] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 }, Status: INVALID_TERM, Last received: 3.1076, Next index: 1077, Last known committed idx: 1074, Time since last communication: 0.000s
I20260429 19:55:32.764835 12642 leader_election.cc:290] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [CANDIDATE]: Term 4 election: Requested vote from peers c716e625b12e48419e4855fc59197a15 (127.10.32.66:43535), 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215)
I20260429 19:55:32.769804 13210 raft_consensus.cc:3055] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 3 LEADER]: Stepping down as leader of term 3
I20260429 19:55:32.769956 13210 raft_consensus.cc:740] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c716e625b12e48419e4855fc59197a15, State: Running, Role: LEADER
I20260429 19:55:32.770359 13210 consensus_queue.cc:260] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1076, Committed index: 1076, Last appended: 3.1077, Last appended by leader: 1077, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:32.772560 13210 raft_consensus.cc:3060] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 3 FOLLOWER]: Advancing to term 4
W20260429 19:55:32.777940 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
I20260429 19:55:32.778765 12642 raft_consensus.cc:1240] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 4 FOLLOWER]: Rejecting Update request from peer c716e625b12e48419e4855fc59197a15 for earlier term 3. Current term is 4. Ops: [3.1077-3.1077]
I20260429 19:55:32.782598 12504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "7c14d1f90d944ae4b2f546d620ec249c" candidate_term: 4 candidate_status { last_received { term: 3 index: 1076 } } ignore_live_leader: true dest_uuid: "c716e625b12e48419e4855fc59197a15"
I20260429 19:55:32.783036 12504 raft_consensus.cc:2410] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c14d1f90d944ae4b2f546d620ec249c for term 4 because replica has last-logged OpId of term: 3 index: 1077, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 1076.
W20260429 19:55:32.785131 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
I20260429 19:55:32.794243 12800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "7c14d1f90d944ae4b2f546d620ec249c" candidate_term: 4 candidate_status { last_received { term: 3 index: 1076 } } ignore_live_leader: true dest_uuid: "5fd13bd23da4400b90382adbc6d22955"
I20260429 19:55:32.794622 12800 raft_consensus.cc:3060] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 3 FOLLOWER]: Advancing to term 4
I20260429 19:55:32.797856 12800 raft_consensus.cc:2410] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c14d1f90d944ae4b2f546d620ec249c for term 4 because replica has last-logged OpId of term: 3 index: 1077, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 1076.
I20260429 19:55:32.809286 12577 leader_election.cc:304] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c14d1f90d944ae4b2f546d620ec249c; no voters: 5fd13bd23da4400b90382adbc6d22955, c716e625b12e48419e4855fc59197a15
I20260429 19:55:32.811745 13233 raft_consensus.cc:2749] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260429 19:55:32.823732 12757 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:32.825382 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:32.831513 12600 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:32.832753 12603 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
I20260429 19:55:32.834246 12623 tablet_service.cc:1460] Tablet server 7c14d1f90d944ae4b2f546d620ec249c set to quiescing
I20260429 19:55:32.834506 12623 tablet_service.cc:1467] Tablet server has 0 leaders and 3 scanners
W20260429 19:55:32.841202 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:32.844684 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:32.849833 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:32.855803 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:32.858654 12599 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:32.867691 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:32.872825 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:32.882877 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:32.884483 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:32.897663 12603 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:32.898661 12600 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:32.908854 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:32.914732 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:32.927517 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:32.930433 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:32.943297 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:32.948035 12601 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:32.958031 12600 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:32.967553 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:32.975967 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:32.986177 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:32.992126 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.004118 12599 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:33.011581 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:33.024756 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.034579 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.047420 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.055409 13210 raft_consensus.cc:670] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: failed to trigger leader election: Illegal state: leader elections are disabled
W20260429 19:55:33.058060 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.070973 12601 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:33.072085 13236 raft_consensus.cc:670] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: failed to trigger leader election: Illegal state: leader elections are disabled
W20260429 19:55:33.078495 12600 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:33.094022 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.105003 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.116056 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.126677 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.135679 13233 raft_consensus.cc:670] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: failed to trigger leader election: Illegal state: leader elections are disabled
W20260429 19:55:33.138680 12601 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:33.148766 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:33.166528 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.177461 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.191692 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.204145 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.218441 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:33.233793 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:33.248783 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.262784 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.276835 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.291129 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.309283 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:33.319823 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:33.341513 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.352072 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.373453 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.386989 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.406160 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:33.422632 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:33.443591 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.460553 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.479816 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.498380 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.516649 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:33.534153 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:33.553994 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.571969 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.592506 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.610625 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.632982 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:33.651319 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:33.677397 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.694502 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.721221 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.735716 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.761837 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:33.776017 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:33.807045 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.821763 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.854094 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.868772 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.898204 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:33.915669 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:33.951547 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.965657 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:33.997018 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:34.015949 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:34.047902 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:34.065804 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:34.101702 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:34.119640 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:34.152382 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:34.168802 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:34.206545 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:34.219015 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:34.264276 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:34.273257 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:34.318955 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:34.326313 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
I20260429 19:55:34.357851 12484 tablet_service.cc:1460] Tablet server c716e625b12e48419e4855fc59197a15 set to quiescing
I20260429 19:55:34.358151 12484 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260429 19:55:34.376269 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:34.380313 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:34.433893 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:34.439795 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
I20260429 19:55:34.461733 12623 tablet_service.cc:1460] Tablet server 7c14d1f90d944ae4b2f546d620ec249c set to quiescing
I20260429 19:55:34.461971 12623 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260429 19:55:34.492283 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:34.494127 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:34.549834 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:34.551930 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
I20260429 19:55:34.605471 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 12420
W20260429 19:55:34.609838 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:34.611131 12462 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59456: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
I20260429 19:55:34.613157 12543 generic_service.cc:196] Checking for leaks (request via RPC)
W20260429 19:55:34.670616 12758 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:34.671377 12757 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:34.730721 12601 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:34.730746 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
I20260429 19:55:34.771667 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 12420
W20260429 19:55:34.800765 12217 connection.cc:570] client connection to 127.10.32.66:43535 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260429 19:55:34.801076 12217 meta_cache.cc:302] tablet b25d2531d0c044f7b297f7f323e75414: replica c716e625b12e48419e4855fc59197a15 (127.10.32.66:43535) has failed: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260429 19:55:34.801589 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.32.66:43535
--local_ip_for_outbound_sockets=127.10.32.66
--tserver_master_addrs=127.10.32.126:36395
--webserver_port=35497
--webserver_interface=127.10.32.66
--builtin_ntp_servers=127.10.32.84:40073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260429 19:55:34.861655 12757 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:34.863790 12757 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:34.926329 12602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:34.927239 12601 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:35.060822 12757 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:35.125859 12757 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:35.129957 12601 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:35.164175 13263 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:55:35.164522 13263 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:55:35.164640 13263 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:55:35.173805 13263 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:55:35.174041 13263 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.32.66
I20260429 19:55:35.185474 13263 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.32.66:43535
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.32.66
--webserver_port=35497
--tserver_master_addrs=127.10.32.126:36395
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.32.66
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:55:35.187172 13263 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:55:35.189000 13263 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260429 19:55:35.192929 13263 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260429 19:55:35.194536 12601 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:35.199388 13269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:35.199442 13270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:35.201124 13272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:55:35.201436 13263 server_base.cc:1061] running on GCE node
I20260429 19:55:35.202183 13263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 19:55:35.203368 13263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:55:35.204618 13263 hybrid_clock.cc:648] HybridClock initialized: now 1777492535204510 us; error 80 us; skew 500 ppm
I20260429 19:55:35.204938 13263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:55:35.207438 13263 webserver.cc:492] Webserver started at http://127.10.32.66:35497/ using document root <none> and password file <none>
I20260429 19:55:35.208213 13263 fs_manager.cc:362] Metadata directory not provided
I20260429 19:55:35.208345 13263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 19:55:35.214136 13263 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.005s sys 0.001s
I20260429 19:55:35.217346 13278 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:35.218993 13263 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260429 19:55:35.219197 13263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/wal
uuid: "c716e625b12e48419e4855fc59197a15"
format_stamp: "Formatted at 2026-04-29 19:55:11 on dist-test-slave-hwg5"
I20260429 19:55:35.219995 13263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 19:55:35.237434 13263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:55:35.238605 13263 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:55:35.238903 13263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:55:35.240069 13263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 19:55:35.242923 13285 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260429 19:55:35.249177 13263 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260429 19:55:35.249342 13263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260429 19:55:35.249465 13263 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260429 19:55:35.253971 13263 ts_tablet_manager.cc:616] Registered 1 tablets
I20260429 19:55:35.254076 13263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.005s user 0.002s sys 0.000s
I20260429 19:55:35.254662 13285 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Bootstrap starting.
W20260429 19:55:35.266152 12757 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
I20260429 19:55:35.300812 13263 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.66:43535
I20260429 19:55:35.300828 13391 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.66:43535 every 8 connection(s)
I20260429 19:55:35.303112 13263 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data/info.pb
I20260429 19:55:35.305755 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 13263
I20260429 19:55:35.305999 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 12558
W20260429 19:55:35.330955 12757 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:35.335685 12601 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
I20260429 19:55:35.343333 12683 generic_service.cc:196] Checking for leaks (request via RPC)
I20260429 19:55:35.352854 13392 heartbeater.cc:344] Connected to a master server at 127.10.32.126:36395
I20260429 19:55:35.353268 13392 heartbeater.cc:461] Registering TS with master...
I20260429 19:55:35.354522 13392 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:35.357921 11625 ts_manager.cc:194] Re-registered known tserver with Master: c716e625b12e48419e4855fc59197a15 (127.10.32.66:43535)
I20260429 19:55:35.359889 11625 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.32.66:44437
W20260429 19:55:35.500093 12757 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:35.540570 12601 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34336: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
I20260429 19:55:35.541258 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 12558
W20260429 19:55:35.600235 12217 connection.cc:570] client connection to 127.10.32.67:44017 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260429 19:55:35.600813 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.32.67:44017
--local_ip_for_outbound_sockets=127.10.32.67
--tserver_master_addrs=127.10.32.126:36395
--webserver_port=39603
--webserver_interface=127.10.32.67
--builtin_ntp_servers=127.10.32.84:40073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260429 19:55:35.601649 13285 log.cc:826] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Log is configured to *not* fsync() on all Append() calls
I20260429 19:55:35.698825 12253 meta_cache.cc:1510] marking tablet server 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017) as failed
W20260429 19:55:35.754812 12757 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:35.765144 12757 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:35.841307 12217 meta_cache.cc:302] tablet b25d2531d0c044f7b297f7f323e75414: replica 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017) has failed: Network error: Client connection negotiation failed: client connection to 127.10.32.67:44017: connect: Connection refused (error 111)
W20260429 19:55:35.911479 12757 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:35.983301 13401 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:55:35.983650 13401 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:55:35.983775 13401 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:55:35.994274 13401 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:55:35.994581 13401 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.32.67
W20260429 19:55:35.996881 12757 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
I20260429 19:55:36.006929 13401 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.32.67:44017
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.32.67
--webserver_port=39603
--tserver_master_addrs=127.10.32.126:36395
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.32.67
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:55:36.008621 13401 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:55:36.010622 13401 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260429 19:55:36.014783 13401 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260429 19:55:36.022336 13407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:36.022344 13406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:36.024466 13409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:55:36.025193 13401 server_base.cc:1061] running on GCE node
I20260429 19:55:36.026051 13401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 19:55:36.027462 13401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:55:36.028793 13401 hybrid_clock.cc:648] HybridClock initialized: now 1777492536028680 us; error 66 us; skew 500 ppm
I20260429 19:55:36.029325 13401 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:55:36.032680 13401 webserver.cc:492] Webserver started at http://127.10.32.67:39603/ using document root <none> and password file <none>
I20260429 19:55:36.033742 13401 fs_manager.cc:362] Metadata directory not provided
I20260429 19:55:36.033908 13401 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 19:55:36.042362 13401 fs_manager.cc:714] Time spent opening directory manager: real 0.006s user 0.005s sys 0.001s
I20260429 19:55:36.046655 13415 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:36.048456 13401 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260429 19:55:36.048657 13401 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/wal
uuid: "7c14d1f90d944ae4b2f546d620ec249c"
format_stamp: "Formatted at 2026-04-29 19:55:11 on dist-test-slave-hwg5"
I20260429 19:55:36.049683 13401 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 19:55:36.076543 13401 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:55:36.077705 13401 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:55:36.078042 13401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:55:36.079437 13401 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 19:55:36.082497 13422 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260429 19:55:36.088680 13401 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260429 19:55:36.088857 13401 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260429 19:55:36.088991 13401 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260429 19:55:36.092521 13401 ts_tablet_manager.cc:616] Registered 1 tablets
I20260429 19:55:36.092619 13401 ts_tablet_manager.cc:595] Time spent register tablets: real 0.004s user 0.000s sys 0.002s
I20260429 19:55:36.093210 13422 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Bootstrap starting.
W20260429 19:55:36.153074 12757 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55024: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
I20260429 19:55:36.155732 13401 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.67:44017
I20260429 19:55:36.155766 13528 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.67:44017 every 8 connection(s)
I20260429 19:55:36.157559 13401 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data/info.pb
I20260429 19:55:36.162829 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 13401
I20260429 19:55:36.163079 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 12700
I20260429 19:55:36.189190 13529 heartbeater.cc:344] Connected to a master server at 127.10.32.126:36395
I20260429 19:55:36.189563 13529 heartbeater.cc:461] Registering TS with master...
I20260429 19:55:36.190860 12846 generic_service.cc:196] Checking for leaks (request via RPC)
I20260429 19:55:36.190935 13529 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:36.194324 11625 ts_manager.cc:194] Re-registered known tserver with Master: 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017)
I20260429 19:55:36.196063 11625 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.32.67:54493
I20260429 19:55:36.363899 13392 heartbeater.cc:499] Master 127.10.32.126:36395 was elected leader, sending a full tablet report...
I20260429 19:55:36.382861 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 12700
I20260429 19:55:36.409512 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.32.65:38215
--local_ip_for_outbound_sockets=127.10.32.65
--tserver_master_addrs=127.10.32.126:36395
--webserver_port=33319
--webserver_interface=127.10.32.65
--builtin_ntp_servers=127.10.32.84:40073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260429 19:55:36.606107 13422 log.cc:826] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Log is configured to *not* fsync() on all Append() calls
W20260429 19:55:36.814085 13537 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:55:36.814579 13537 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:55:36.814739 13537 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:55:36.829162 13537 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:55:36.829509 13537 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.32.65
I20260429 19:55:36.846662 13537 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.32.65:38215
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.32.65
--webserver_port=33319
--tserver_master_addrs=127.10.32.126:36395
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.32.65
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:55:36.848745 13537 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:55:36.851344 13537 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260429 19:55:36.856683 13537 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260429 19:55:36.862910 12219 meta_cache.cc:302] tablet b25d2531d0c044f7b297f7f323e75414: replica 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215) has failed: Network error: Client connection negotiation failed: client connection to 127.10.32.65:38215: connect: Connection refused (error 111)
W20260429 19:55:36.865271 13543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:36.867535 13544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:55:36.873183 13537 server_base.cc:1061] running on GCE node
W20260429 19:55:36.873459 13546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:55:36.874306 13537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 19:55:36.875608 13537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:55:36.876912 13537 hybrid_clock.cc:648] HybridClock initialized: now 1777492536876829 us; error 56 us; skew 500 ppm
I20260429 19:55:36.877287 13537 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:55:36.881824 13537 webserver.cc:492] Webserver started at http://127.10.32.65:33319/ using document root <none> and password file <none>
I20260429 19:55:36.882932 13537 fs_manager.cc:362] Metadata directory not provided
I20260429 19:55:36.883095 13537 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 19:55:36.891461 13537 fs_manager.cc:714] Time spent opening directory manager: real 0.005s user 0.007s sys 0.000s
I20260429 19:55:36.895750 13552 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:36.897678 13537 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260429 19:55:36.897876 13537 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/wal
uuid: "5fd13bd23da4400b90382adbc6d22955"
format_stamp: "Formatted at 2026-04-29 19:55:10 on dist-test-slave-hwg5"
I20260429 19:55:36.899019 13537 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 19:55:36.953408 13537 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:55:36.954609 13537 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:55:36.955121 13537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:55:36.956581 13537 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 19:55:36.962872 13559 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260429 19:55:36.971562 13537 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260429 19:55:36.971735 13537 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.012s user 0.001s sys 0.003s
I20260429 19:55:36.971894 13537 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260429 19:55:36.976408 13537 ts_tablet_manager.cc:616] Registered 1 tablets
I20260429 19:55:36.976589 13537 ts_tablet_manager.cc:595] Time spent register tablets: real 0.005s user 0.005s sys 0.000s
I20260429 19:55:36.977231 13559 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Bootstrap starting.
I20260429 19:55:37.200100 13529 heartbeater.cc:499] Master 127.10.32.126:36395 was elected leader, sending a full tablet report...
I20260429 19:55:37.279531 12252 meta_cache.cc:1510] marking tablet server 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215) as failed
I20260429 19:55:37.309576 12253 meta_cache.cc:1510] marking tablet server 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215) as failed
I20260429 19:55:37.570858 13559 log.cc:826] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Log is configured to *not* fsync() on all Append() calls
I20260429 19:55:37.767446 13666 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.65:38215 every 8 connection(s)
I20260429 19:55:37.767863 13537 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.65:38215
I20260429 19:55:37.769980 13537 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data/info.pb
I20260429 19:55:37.771517 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 13537
I20260429 19:55:37.771745 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 12872
I20260429 19:55:37.822820 13000 generic_service.cc:196] Checking for leaks (request via RPC)
I20260429 19:55:37.859813 13667 heartbeater.cc:344] Connected to a master server at 127.10.32.126:36395
I20260429 19:55:37.860258 13667 heartbeater.cc:461] Registering TS with master...
I20260429 19:55:37.861392 13667 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:37.864959 11621 ts_manager.cc:194] Re-registered known tserver with Master: 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215)
I20260429 19:55:37.866703 11621 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.32.65:54349
I20260429 19:55:37.990123 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 12872
I20260429 19:55:38.015839 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.32.68:37785
--local_ip_for_outbound_sockets=127.10.32.68
--tserver_master_addrs=127.10.32.126:36395
--webserver_port=37295
--webserver_interface=127.10.32.68
--builtin_ntp_servers=127.10.32.84:40073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260429 19:55:38.632890 13675 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:55:38.633426 13675 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:55:38.633612 13675 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:55:38.647759 13675 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:55:38.648149 13675 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.32.68
I20260429 19:55:38.665228 13675 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.32.68:37785
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.10.32.68
--webserver_port=37295
--tserver_master_addrs=127.10.32.126:36395
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.32.68
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:55:38.667586 13675 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:55:38.670091 13675 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260429 19:55:38.675740 13675 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260429 19:55:38.706748 13680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:38.710784 13681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:55:38.715580 13675 server_base.cc:1061] running on GCE node
W20260429 19:55:38.716070 13684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:55:38.716964 13675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 19:55:38.725487 13675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:55:38.727674 13675 hybrid_clock.cc:648] HybridClock initialized: now 1777492538727513 us; error 156 us; skew 500 ppm
I20260429 19:55:38.728192 13675 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:55:38.744239 13675 webserver.cc:492] Webserver started at http://127.10.32.68:37295/ using document root <none> and password file <none>
I20260429 19:55:38.745473 13675 fs_manager.cc:362] Metadata directory not provided
I20260429 19:55:38.745786 13675 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 19:55:38.753687 13675 fs_manager.cc:714] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260429 19:55:38.765651 13689 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:38.767756 13675 fs_manager.cc:730] Time spent opening block manager: real 0.010s user 0.008s sys 0.000s
I20260429 19:55:38.768057 13675 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/wal
uuid: "25e23c8f6f1d4fc299d315619fcd4021"
format_stamp: "Formatted at 2026-04-29 19:55:12 on dist-test-slave-hwg5"
I20260429 19:55:38.769132 13675 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 19:55:38.824038 13675 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:55:38.825407 13675 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:55:38.825939 13675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:55:38.833595 13675 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 19:55:38.842589 13675 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260429 19:55:38.842811 13675 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:38.843003 13675 ts_tablet_manager.cc:616] Registered 0 tablets
I20260429 19:55:38.843128 13675 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:38.870502 13667 heartbeater.cc:499] Master 127.10.32.126:36395 was elected leader, sending a full tablet report...
I20260429 19:55:39.661609 13801 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.68:37785 every 8 connection(s)
I20260429 19:55:39.661971 13675 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.68:37785
I20260429 19:55:39.664409 13675 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data/info.pb
I20260429 19:55:39.671391 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 13675
I20260429 19:55:39.736348 13802 heartbeater.cc:344] Connected to a master server at 127.10.32.126:36395
I20260429 19:55:39.736811 13802 heartbeater.cc:461] Registering TS with master...
I20260429 19:55:39.737946 13802 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:39.739820 11621 ts_manager.cc:194] Re-registered known tserver with Master: 25e23c8f6f1d4fc299d315619fcd4021 (127.10.32.68:37785)
I20260429 19:55:39.740954 11621 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.32.68:41343
I20260429 19:55:39.911741 13285 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Bootstrap replayed 1/1 log segments. Stats: ops{read=1077 overwritten=0 applied=1076 ignored=0} inserts{seen=53700 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260429 19:55:39.912680 13285 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Bootstrap complete.
I20260429 19:55:39.914657 13285 ts_tablet_manager.cc:1403] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Time spent bootstrapping tablet: real 4.660s user 4.157s sys 0.268s
I20260429 19:55:39.922111 13285 raft_consensus.cc:359] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 4 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:39.933827 13285 raft_consensus.cc:740] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716e625b12e48419e4855fc59197a15, State: Initialized, Role: FOLLOWER
I20260429 19:55:39.934751 13285 consensus_queue.cc:260] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1076, Last appended: 3.1077, Last appended by leader: 1077, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:39.943166 13285 ts_tablet_manager.cc:1434] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Time spent starting tablet: real 0.028s user 0.005s sys 0.020s
W20260429 19:55:40.035806 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:40.044548 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
I20260429 19:55:40.197201 13808 raft_consensus.cc:493] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:55:40.197499 13808 raft_consensus.cc:515] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:40.199677 13808 leader_election.cc:290] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215), 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017)
I20260429 19:55:40.270172 13621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "c716e625b12e48419e4855fc59197a15" candidate_term: 5 candidate_status { last_received { term: 3 index: 1077 } } ignore_live_leader: false dest_uuid: "5fd13bd23da4400b90382adbc6d22955" is_pre_election: true
W20260429 19:55:40.274107 13281 leader_election.cc:343] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 5 pre-election: Tablet error from VoteRequest() call to peer 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215): Illegal state: must be running to vote when last-logged opid is not known
I20260429 19:55:40.279340 13484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "c716e625b12e48419e4855fc59197a15" candidate_term: 5 candidate_status { last_received { term: 3 index: 1077 } } ignore_live_leader: false dest_uuid: "7c14d1f90d944ae4b2f546d620ec249c" is_pre_election: true
W20260429 19:55:40.283375 13279 leader_election.cc:343] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 5 pre-election: Tablet error from VoteRequest() call to peer 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017): Illegal state: must be running to vote when last-logged opid is not known
I20260429 19:55:40.283555 13279 leader_election.cc:304] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c716e625b12e48419e4855fc59197a15; no voters: 5fd13bd23da4400b90382adbc6d22955, 7c14d1f90d944ae4b2f546d620ec249c
I20260429 19:55:40.284024 13808 raft_consensus.cc:2749] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260429 19:55:40.387302 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:40.408094 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
I20260429 19:55:40.500835 13601 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260429 19:55:40.509918 13464 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260429 19:55:40.513032 13737 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260429 19:55:40.518348 13327 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260429 19:55:40.672282 13808 raft_consensus.cc:493] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:55:40.672493 13808 raft_consensus.cc:515] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:40.673218 13808 leader_election.cc:290] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215), 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017)
I20260429 19:55:40.674141 13484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "c716e625b12e48419e4855fc59197a15" candidate_term: 5 candidate_status { last_received { term: 3 index: 1077 } } ignore_live_leader: false dest_uuid: "7c14d1f90d944ae4b2f546d620ec249c" is_pre_election: true
I20260429 19:55:40.674153 13621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "c716e625b12e48419e4855fc59197a15" candidate_term: 5 candidate_status { last_received { term: 3 index: 1077 } } ignore_live_leader: false dest_uuid: "5fd13bd23da4400b90382adbc6d22955" is_pre_election: true
W20260429 19:55:40.674908 13279 leader_election.cc:343] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 5 pre-election: Tablet error from VoteRequest() call to peer 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017): Illegal state: must be running to vote when last-logged opid is not known
W20260429 19:55:40.675392 13281 leader_election.cc:343] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 5 pre-election: Tablet error from VoteRequest() call to peer 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215): Illegal state: must be running to vote when last-logged opid is not known
I20260429 19:55:40.675534 13281 leader_election.cc:304] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c716e625b12e48419e4855fc59197a15; no voters: 5fd13bd23da4400b90382adbc6d22955, 7c14d1f90d944ae4b2f546d620ec249c
I20260429 19:55:40.675832 13808 raft_consensus.cc:2749] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260429 19:55:40.744589 13802 heartbeater.cc:499] Master 127.10.32.126:36395 was elected leader, sending a full tablet report...
W20260429 19:55:40.760214 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:40.782928 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
I20260429 19:55:40.991281 13422 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1076 overwritten=0 applied=1074 ignored=0} inserts{seen=53600 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260429 19:55:40.991966 13422 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Bootstrap complete.
I20260429 19:55:40.993276 13422 ts_tablet_manager.cc:1403] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Time spent bootstrapping tablet: real 4.901s user 4.303s sys 0.297s
I20260429 19:55:40.997011 13422 raft_consensus.cc:359] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 4 FOLLOWER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:41.000267 13422 raft_consensus.cc:740] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c14d1f90d944ae4b2f546d620ec249c, State: Initialized, Role: FOLLOWER
I20260429 19:55:41.001130 13422 consensus_queue.cc:260] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1074, Last appended: 3.1076, Last appended by leader: 1076, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:41.003137 13422 ts_tablet_manager.cc:1434] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Time spent starting tablet: real 0.010s user 0.012s sys 0.000s
W20260429 19:55:41.009578 13444 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:41.033278 13444 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
I20260429 19:55:41.131814 13808 raft_consensus.cc:493] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:55:41.132042 13808 raft_consensus.cc:515] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:41.132717 13808 leader_election.cc:290] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215), 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017)
I20260429 19:55:41.133288 13621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "c716e625b12e48419e4855fc59197a15" candidate_term: 5 candidate_status { last_received { term: 3 index: 1077 } } ignore_live_leader: false dest_uuid: "5fd13bd23da4400b90382adbc6d22955" is_pre_election: true
I20260429 19:55:41.133304 13484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "c716e625b12e48419e4855fc59197a15" candidate_term: 5 candidate_status { last_received { term: 3 index: 1077 } } ignore_live_leader: false dest_uuid: "7c14d1f90d944ae4b2f546d620ec249c" is_pre_election: true
I20260429 19:55:41.133689 13484 raft_consensus.cc:2468] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c716e625b12e48419e4855fc59197a15 in term 4.
W20260429 19:55:41.133798 13281 leader_election.cc:343] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 5 pre-election: Tablet error from VoteRequest() call to peer 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215): Illegal state: must be running to vote when last-logged opid is not known
I20260429 19:55:41.134155 13279 leader_election.cc:304] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c14d1f90d944ae4b2f546d620ec249c, c716e625b12e48419e4855fc59197a15; no voters: 5fd13bd23da4400b90382adbc6d22955
I20260429 19:55:41.134477 13808 raft_consensus.cc:2804] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260429 19:55:41.134604 13808 raft_consensus.cc:493] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 19:55:41.134711 13808 raft_consensus.cc:3060] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 4 FOLLOWER]: Advancing to term 5
W20260429 19:55:41.137686 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
I20260429 19:55:41.138765 13808 raft_consensus.cc:515] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:41.139411 13808 leader_election.cc:290] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 5 election: Requested vote from peers 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215), 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017)
I20260429 19:55:41.139806 13621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "c716e625b12e48419e4855fc59197a15" candidate_term: 5 candidate_status { last_received { term: 3 index: 1077 } } ignore_live_leader: false dest_uuid: "5fd13bd23da4400b90382adbc6d22955"
I20260429 19:55:41.140008 13484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "c716e625b12e48419e4855fc59197a15" candidate_term: 5 candidate_status { last_received { term: 3 index: 1077 } } ignore_live_leader: false dest_uuid: "7c14d1f90d944ae4b2f546d620ec249c"
I20260429 19:55:41.140232 13484 raft_consensus.cc:3060] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 4 FOLLOWER]: Advancing to term 5
W20260429 19:55:41.140398 13281 leader_election.cc:343] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 5 election: Tablet error from VoteRequest() call to peer 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215): Illegal state: must be running to vote when last-logged opid is not known
I20260429 19:55:41.143939 13484 raft_consensus.cc:2468] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716e625b12e48419e4855fc59197a15 in term 5.
I20260429 19:55:41.144420 13279 leader_election.cc:304] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c14d1f90d944ae4b2f546d620ec249c, c716e625b12e48419e4855fc59197a15; no voters: 5fd13bd23da4400b90382adbc6d22955
I20260429 19:55:41.144804 13808 raft_consensus.cc:2804] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 5 FOLLOWER]: Leader election won for term 5
I20260429 19:55:41.145267 13808 raft_consensus.cc:697] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 5 LEADER]: Becoming Leader. State: Replica: c716e625b12e48419e4855fc59197a15, State: Running, Role: LEADER
I20260429 19:55:41.146004 13808 consensus_queue.cc:237] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1076, Committed index: 1076, Last appended: 3.1077, Last appended by leader: 1077, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:41.150537 11625 catalog_manager.cc:5671] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c716e625b12e48419e4855fc59197a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } health_report { overall_health: UNKNOWN } } }
W20260429 19:55:41.166313 13281 consensus_peers.cc:597] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 -> Peer 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215): Couldn't send request to peer 5fd13bd23da4400b90382adbc6d22955. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260429 19:55:41.166481 13484 raft_consensus.cc:1275] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 5 FOLLOWER]: Refusing update from remote peer c716e625b12e48419e4855fc59197a15: Log matching property violated. Preceding OpId in replica: term: 3 index: 1076. Preceding OpId from leader: term: 5 index: 1079. (index mismatch)
I20260429 19:55:41.167419 13808 consensus_queue.cc:1048] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1078, Last known committed idx: 1074, Time since last communication: 0.000s
I20260429 19:55:41.177817 13846 mvcc.cc:204] Tried to move back new op lower bound from 7280609448607830016 to 7280609448537710592. Current Snapshot: MvccSnapshot[applied={T|T < 7280609414181142528}]
I20260429 19:55:41.184087 13858 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57150 (ReqId={client: ad11d96cb7b34d64908044a7fa40f6d9, seq_no=1074, attempt_no=78}) took 1211 ms. Trace:
I20260429 19:55:41.184279 13858 rpcz_store.cc:276] 0429 19:55:39.972553 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 19:55:39.972621 (+ 68us) service_pool.cc:225] Handling call
0429 19:55:41.184008 (+1211387us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260429 19:55:41.227468 12251 scanner-internal.cc:458] Time spent opening tablet: real 7.936s user 0.004s sys 0.004s
W20260429 19:55:41.390784 13442 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:41.407509 13444 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:41.491304 12252 scanner-internal.cc:458] Time spent opening tablet: real 8.136s user 0.009s sys 0.002s
W20260429 19:55:41.673578 13281 consensus_peers.cc:597] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 -> Peer 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215): Couldn't send request to peer 5fd13bd23da4400b90382adbc6d22955. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260429 19:55:41.740649 12253 scanner-internal.cc:458] Time spent opening tablet: real 8.458s user 0.007s sys 0.004s
I20260429 19:55:41.902446 13559 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Bootstrap replayed 1/1 log segments. Stats: ops{read=1077 overwritten=0 applied=1076 ignored=0} inserts{seen=53700 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260429 19:55:41.903388 13559 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Bootstrap complete.
I20260429 19:55:41.905275 13559 ts_tablet_manager.cc:1403] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Time spent bootstrapping tablet: real 4.929s user 4.323s sys 0.292s
I20260429 19:55:41.909042 13559 raft_consensus.cc:359] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 4 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:41.926488 13559 raft_consensus.cc:740] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fd13bd23da4400b90382adbc6d22955, State: Initialized, Role: FOLLOWER
I20260429 19:55:41.927609 13559 consensus_queue.cc:260] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1076, Last appended: 3.1077, Last appended by leader: 1077, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:41.943020 13559 ts_tablet_manager.cc:1434] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Time spent starting tablet: real 0.038s user 0.024s sys 0.012s
I20260429 19:55:42.021268 13621 raft_consensus.cc:3060] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 4 FOLLOWER]: Advancing to term 5
I20260429 19:55:42.319479 13863 mvcc.cc:204] Tried to move back new op lower bound from 7280609452078792704 to 7280609448537710592. Current Snapshot: MvccSnapshot[applied={T|T < 7280609452078792704 or (T in {7280609452078792704})}]
I20260429 19:55:47.207931 13737 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260429 19:55:47.277117 13601 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260429 19:55:47.291658 13464 tablet_service.cc:1467] Tablet server has 0 leaders and 3 scanners
I20260429 19:55:47.366726 13327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260429 19:55:48.899367 11625 ts_manager.cc:284] Unset tserver state for c716e625b12e48419e4855fc59197a15 from MAINTENANCE_MODE
I20260429 19:55:48.907612 11621 ts_manager.cc:284] Unset tserver state for 5fd13bd23da4400b90382adbc6d22955 from MAINTENANCE_MODE
I20260429 19:55:49.190094 13667 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:49.198441 13392 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:49.217796 13529 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:49.577229 11621 ts_manager.cc:284] Unset tserver state for 7c14d1f90d944ae4b2f546d620ec249c from MAINTENANCE_MODE
I20260429 19:55:49.776141 13802 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:50.013209 11621 ts_manager.cc:284] Unset tserver state for 25e23c8f6f1d4fc299d315619fcd4021 from MAINTENANCE_MODE
I20260429 19:55:50.196760 13667 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:50.207214 13392 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:50.227077 13529 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:50.780048 13802 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:51.798804 11621 ts_manager.cc:295] Set tserver state for 7c14d1f90d944ae4b2f546d620ec249c to MAINTENANCE_MODE
I20260429 19:55:52.383121 11625 ts_manager.cc:295] Set tserver state for c716e625b12e48419e4855fc59197a15 to MAINTENANCE_MODE
I20260429 19:55:52.553473 11625 ts_manager.cc:295] Set tserver state for 5fd13bd23da4400b90382adbc6d22955 to MAINTENANCE_MODE
I20260429 19:55:52.905215 11625 ts_manager.cc:295] Set tserver state for 25e23c8f6f1d4fc299d315619fcd4021 to MAINTENANCE_MODE
I20260429 19:55:53.448091 13464 tablet_service.cc:1460] Tablet server 7c14d1f90d944ae4b2f546d620ec249c set to quiescing
I20260429 19:55:53.448323 13464 tablet_service.cc:1467] Tablet server has 0 leaders and 3 scanners
I20260429 19:55:53.746249 13327 tablet_service.cc:1460] Tablet server c716e625b12e48419e4855fc59197a15 set to quiescing
I20260429 19:55:53.746600 13327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260429 19:55:53.748431 13999 raft_consensus.cc:993] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: : Instructing follower 5fd13bd23da4400b90382adbc6d22955 to start an election
I20260429 19:55:53.748642 13999 raft_consensus.cc:1081] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 5 LEADER]: Signalling peer 5fd13bd23da4400b90382adbc6d22955 to start an election
I20260429 19:55:53.750453 13619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414"
dest_uuid: "5fd13bd23da4400b90382adbc6d22955"
from {username='slave'} at 127.10.32.66:34333
I20260429 19:55:53.750964 13619 raft_consensus.cc:493] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260429 19:55:53.751319 13619 raft_consensus.cc:3060] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 5 FOLLOWER]: Advancing to term 6
I20260429 19:55:53.755335 13619 raft_consensus.cc:515] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:53.760667 13619 leader_election.cc:290] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [CANDIDATE]: Term 6 election: Requested vote from peers c716e625b12e48419e4855fc59197a15 (127.10.32.66:43535), 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017)
I20260429 19:55:53.793373 13347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "5fd13bd23da4400b90382adbc6d22955" candidate_term: 6 candidate_status { last_received { term: 5 index: 2163 } } ignore_live_leader: true dest_uuid: "c716e625b12e48419e4855fc59197a15"
I20260429 19:55:53.795178 13619 raft_consensus.cc:1240] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 6 FOLLOWER]: Rejecting Update request from peer c716e625b12e48419e4855fc59197a15 for earlier term 5. Current term is 6. Ops: [5.2164-5.2164]
I20260429 19:55:53.796005 13877 consensus_queue.cc:1059] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 }, Status: INVALID_TERM, Last received: 5.2163, Next index: 2164, Last known committed idx: 2163, Time since last communication: 0.000s
I20260429 19:55:53.796932 14017 raft_consensus.cc:3055] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 5 LEADER]: Stepping down as leader of term 5
I20260429 19:55:53.797060 14017 raft_consensus.cc:740] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c716e625b12e48419e4855fc59197a15, State: Running, Role: LEADER
I20260429 19:55:53.797473 14017 consensus_queue.cc:260] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2164, Committed index: 2164, Last appended: 5.2164, Last appended by leader: 2164, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:53.798077 14017 raft_consensus.cc:3060] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 5 FOLLOWER]: Advancing to term 6
I20260429 19:55:53.799480 13620 raft_consensus.cc:1240] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 6 FOLLOWER]: Rejecting Update request from peer c716e625b12e48419e4855fc59197a15 for earlier term 5. Current term is 6. Ops: [5.2164-5.2164]
I20260429 19:55:53.801119 13482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "5fd13bd23da4400b90382adbc6d22955" candidate_term: 6 candidate_status { last_received { term: 5 index: 2163 } } ignore_live_leader: true dest_uuid: "7c14d1f90d944ae4b2f546d620ec249c"
I20260429 19:55:53.801381 13482 raft_consensus.cc:3060] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 5 FOLLOWER]: Advancing to term 6
I20260429 19:55:53.805264 13482 raft_consensus.cc:2410] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5fd13bd23da4400b90382adbc6d22955 for term 6 because replica has last-logged OpId of term: 5 index: 2164, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2163.
W20260429 19:55:53.805384 13854 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.009s ago.
I20260429 19:55:53.806033 13553 leader_election.cc:304] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5fd13bd23da4400b90382adbc6d22955; no voters: 7c14d1f90d944ae4b2f546d620ec249c, c716e625b12e48419e4855fc59197a15
W20260429 19:55:53.817862 13854 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.021s ago.
W20260429 19:55:53.823529 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
I20260429 19:55:53.840229 14076 raft_consensus.cc:2749] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260429 19:55:53.842375 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:53.843685 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:53.844602 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:53.851712 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:53.858632 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:53.860308 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:53.874084 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:53.876951 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:53.883208 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:53.890311 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:53.890488 13579 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:53.893698 13579 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:53.899868 13442 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:53.900848 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:53.907356 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:53.918812 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:53.921092 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:53.926342 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:53.943684 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:53.943776 13579 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:53.944579 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:53.957448 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:53.977005 13442 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:53.977890 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:53.997646 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:53.999251 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:53.999240 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.011559 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.018440 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.019070 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.030072 13443 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.033372 13443 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.035682 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.048959 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.053857 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.056442 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.071074 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.073104 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.075037 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.093457 14017 raft_consensus.cc:670] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: failed to trigger leader election: Illegal state: leader elections are disabled
W20260429 19:55:54.094759 13443 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.096266 13443 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.097922 13443 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.117136 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.121593 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.123847 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.134063 14079 raft_consensus.cc:670] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: failed to trigger leader election: Illegal state: leader elections are disabled
W20260429 19:55:54.136330 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.142877 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.144654 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.158895 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.165267 13444 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.166778 13444 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.185261 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.189483 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.192593 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
I20260429 19:55:54.193427 14076 raft_consensus.cc:493] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:55:54.193658 14076 raft_consensus.cc:515] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:54.194581 14076 leader_election.cc:290] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c716e625b12e48419e4855fc59197a15 (127.10.32.66:43535), 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017)
I20260429 19:55:54.195117 13482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "5fd13bd23da4400b90382adbc6d22955" candidate_term: 7 candidate_status { last_received { term: 5 index: 2163 } } ignore_live_leader: false dest_uuid: "7c14d1f90d944ae4b2f546d620ec249c" is_pre_election: true
I20260429 19:55:54.195397 13482 raft_consensus.cc:2410] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5fd13bd23da4400b90382adbc6d22955 for term 7 because replica has last-logged OpId of term: 5 index: 2164, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2163.
I20260429 19:55:54.195775 13347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "5fd13bd23da4400b90382adbc6d22955" candidate_term: 7 candidate_status { last_received { term: 5 index: 2163 } } ignore_live_leader: false dest_uuid: "c716e625b12e48419e4855fc59197a15" is_pre_election: true
I20260429 19:55:54.196250 13347 raft_consensus.cc:2410] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5fd13bd23da4400b90382adbc6d22955 for term 7 because replica has last-logged OpId of term: 5 index: 2164, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2163.
I20260429 19:55:54.196770 13553 leader_election.cc:304] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5fd13bd23da4400b90382adbc6d22955; no voters: 7c14d1f90d944ae4b2f546d620ec249c, c716e625b12e48419e4855fc59197a15
I20260429 19:55:54.197131 14076 raft_consensus.cc:2749] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260429 19:55:54.211055 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.216296 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.219875 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.237802 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.243873 13444 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.246273 13444 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.266263 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.275231 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.280628 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.292796 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.304416 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.310746 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
I20260429 19:55:54.324782 13737 tablet_service.cc:1460] Tablet server 25e23c8f6f1d4fc299d315619fcd4021 set to quiescing
I20260429 19:55:54.325053 13737 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260429 19:55:54.325906 13442 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.331418 13442 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.337970 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.355890 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.361500 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.369290 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.385816 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.392185 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.399315 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.416549 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.422034 13444 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.429790 13442 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.448920 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.455103 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.464218 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.479450 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.486618 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.496488 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.516577 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.518873 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.533493 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.551385 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.552969 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.569087 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
I20260429 19:55:54.570942 14076 raft_consensus.cc:493] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:55:54.571187 14076 raft_consensus.cc:515] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:55:54.571861 14076 leader_election.cc:290] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c716e625b12e48419e4855fc59197a15 (127.10.32.66:43535), 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017)
I20260429 19:55:54.572717 13482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "5fd13bd23da4400b90382adbc6d22955" candidate_term: 7 candidate_status { last_received { term: 5 index: 2163 } } ignore_live_leader: false dest_uuid: "7c14d1f90d944ae4b2f546d620ec249c" is_pre_election: true
I20260429 19:55:54.572732 13347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "5fd13bd23da4400b90382adbc6d22955" candidate_term: 7 candidate_status { last_received { term: 5 index: 2163 } } ignore_live_leader: false dest_uuid: "c716e625b12e48419e4855fc59197a15" is_pre_election: true
I20260429 19:55:54.573021 13482 raft_consensus.cc:2410] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5fd13bd23da4400b90382adbc6d22955 for term 7 because replica has last-logged OpId of term: 5 index: 2164, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2163.
I20260429 19:55:54.573233 13347 raft_consensus.cc:2410] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5fd13bd23da4400b90382adbc6d22955 for term 7 because replica has last-logged OpId of term: 5 index: 2164, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2163.
I20260429 19:55:54.574434 13553 leader_election.cc:304] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5fd13bd23da4400b90382adbc6d22955; no voters: 7c14d1f90d944ae4b2f546d620ec249c, c716e625b12e48419e4855fc59197a15
I20260429 19:55:54.574928 14076 raft_consensus.cc:2749] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260429 19:55:54.587442 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.589772 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.602447 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
I20260429 19:55:54.608106 13601 tablet_service.cc:1460] Tablet server 5fd13bd23da4400b90382adbc6d22955 set to quiescing
I20260429 19:55:54.608309 13601 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260429 19:55:54.626719 13444 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.629272 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.639904 13444 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.667830 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.670611 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.681596 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.707293 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.710255 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.720477 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.744575 13443 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.748721 13443 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.760839 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.801766 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.801831 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.805083 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.842837 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.844996 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.845969 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.886623 13443 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.887696 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.890746 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:54.931816 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.933849 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.935981 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.939786 14076 raft_consensus.cc:670] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: failed to trigger leader election: Illegal state: leader elections are disabled
W20260429 19:55:54.978336 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.980348 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:54.981833 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.026890 13442 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:55.028090 13442 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:55.028985 13442 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:55.078341 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.079298 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.082614 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.127276 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.130491 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.132580 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.180928 13444 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:55.182425 13443 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:55.186429 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:55.234268 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.235720 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.242909 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.283205 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.288179 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.297676 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.333320 13443 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:55.349665 13444 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:55.353161 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
I20260429 19:55:55.375536 13464 tablet_service.cc:1460] Tablet server 7c14d1f90d944ae4b2f546d620ec249c set to quiescing
I20260429 19:55:55.375788 13464 tablet_service.cc:1467] Tablet server has 0 leaders and 3 scanners
W20260429 19:55:55.389871 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.405948 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.409286 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.443240 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.459503 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.463987 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.496084 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:55.514611 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:55.520377 13442 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:55.551473 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.572369 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.578248 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.607021 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.630301 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
I20260429 19:55:55.634281 13327 tablet_service.cc:1460] Tablet server c716e625b12e48419e4855fc59197a15 set to quiescing
I20260429 19:55:55.634611 13327 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260429 19:55:55.637243 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.663483 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:55.689172 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:55.694660 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:55.723656 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.751462 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.754276 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.781348 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.812197 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.813160 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.841668 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:55.872166 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:55.872330 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:55.907722 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.935325 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.935325 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.968343 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:55.996687 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.000044 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.033397 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:56.058836 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:56.061360 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:56.100987 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.125993 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.128582 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.166476 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.193904 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.194986 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.232149 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:56.261037 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:56.261076 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:56.301921 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.331738 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.331738 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.373018 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.402269 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.402544 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.442072 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:56.473628 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:56.473769 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:56.517122 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.544489 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.546547 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.598272 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.618145 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.620779 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.674124 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:56.693643 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:56.695672 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:56.750895 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.769464 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.770179 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.824494 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.843334 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.845309 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.899348 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:56.919886 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:56.920856 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:56.981812 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:56.998135 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:57.001446 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
I20260429 19:55:57.019927 13464 tablet_service.cc:1460] Tablet server 7c14d1f90d944ae4b2f546d620ec249c set to quiescing
I20260429 19:55:57.020157 13464 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260429 19:55:57.060267 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:57.075220 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:57.077064 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
I20260429 19:55:57.109280 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 13263
I20260429 19:55:57.117851 13386 generic_service.cc:196] Checking for leaks (request via RPC)
W20260429 19:55:57.138491 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:57.153918 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:57.153970 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:57.356714 13307 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:57.357219 13306 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
I20260429 19:55:57.357364 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 13263
W20260429 19:55:57.357362 13305 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57150: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:55:57.397557 11613 connection.cc:570] server connection from 127.10.32.66:44437 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260429 19:55:57.398253 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.32.66:43535
--local_ip_for_outbound_sockets=127.10.32.66
--tserver_master_addrs=127.10.32.126:36395
--webserver_port=35497
--webserver_interface=127.10.32.66
--builtin_ntp_servers=127.10.32.84:40073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260429 19:55:57.408622 12217 meta_cache.cc:302] tablet b25d2531d0c044f7b297f7f323e75414: replica c716e625b12e48419e4855fc59197a15 (127.10.32.66:43535) has failed: Network error: recv got EOF from 127.10.32.66:43535 (error 108)
W20260429 19:55:57.490821 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:57.490828 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:57.491761 13579 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:57.571346 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:57.571542 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:57.575752 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:57.739423 13581 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:57.739513 13579 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:57.741051 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:57.781797 14142 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:55:57.782119 14142 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:55:57.782230 14142 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:55:57.791010 14142 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:55:57.791206 14142 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.32.66
I20260429 19:55:57.801533 14142 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.32.66:43535
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.32.66
--webserver_port=35497
--tserver_master_addrs=127.10.32.126:36395
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.32.66
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:55:57.803133 14142 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:55:57.805243 14142 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260429 19:55:57.809563 14142 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260429 19:55:57.815862 14149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:57.815888 14148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:57.816767 14151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:55:57.817687 14142 server_base.cc:1061] running on GCE node
I20260429 19:55:57.818445 14142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 19:55:57.819514 14142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:55:57.820756 14142 hybrid_clock.cc:648] HybridClock initialized: now 1777492557820662 us; error 77 us; skew 500 ppm
I20260429 19:55:57.821038 14142 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260429 19:55:57.823504 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
I20260429 19:55:57.823654 14142 webserver.cc:492] Webserver started at http://127.10.32.66:35497/ using document root <none> and password file <none>
I20260429 19:55:57.824678 14142 fs_manager.cc:362] Metadata directory not provided
I20260429 19:55:57.824815 14142 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260429 19:55:57.824759 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:57.824759 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
I20260429 19:55:57.830880 14142 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260429 19:55:57.834197 14157 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:57.835826 14142 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260429 19:55:57.836033 14142 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/wal
uuid: "c716e625b12e48419e4855fc59197a15"
format_stamp: "Formatted at 2026-04-29 19:55:11 on dist-test-slave-hwg5"
I20260429 19:55:57.837003 14142 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 19:55:57.863888 14142 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:55:57.864895 14142 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:55:57.865199 14142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:55:57.866302 14142 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 19:55:57.868871 14164 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260429 19:55:57.875156 14142 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260429 19:55:57.875607 14142 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260429 19:55:57.875804 14142 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260429 19:55:57.879209 14142 ts_tablet_manager.cc:616] Registered 1 tablets
I20260429 19:55:57.879326 14142 ts_tablet_manager.cc:595] Time spent register tablets: real 0.004s user 0.003s sys 0.000s
I20260429 19:55:57.879815 14164 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Bootstrap starting.
I20260429 19:55:57.929828 14142 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.66:43535
I20260429 19:55:57.929908 14270 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.66:43535 every 8 connection(s)
I20260429 19:55:57.931524 14142 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-1/data/info.pb
I20260429 19:55:57.935719 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 14142
I20260429 19:55:57.935947 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 13401
I20260429 19:55:57.954927 14271 heartbeater.cc:344] Connected to a master server at 127.10.32.126:36395
I20260429 19:55:57.955411 14271 heartbeater.cc:461] Registering TS with master...
I20260429 19:55:57.956652 14271 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:57.956826 13523 generic_service.cc:196] Checking for leaks (request via RPC)
I20260429 19:55:57.959857 11625 ts_manager.cc:194] Re-registered known tserver with Master: c716e625b12e48419e4855fc59197a15 (127.10.32.66:43535)
I20260429 19:55:57.961436 11625 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.32.66:38985
W20260429 19:55:57.995301 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:58.000759 13579 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:58.000765 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:58.195088 13440 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:58.195999 13442 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:55:58.196969 13441 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33654: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
I20260429 19:55:58.197968 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 13401
W20260429 19:55:58.241355 12217 connection.cc:570] client connection to 127.10.32.67:44017 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260429 19:55:58.241664 12253 meta_cache.cc:1510] marking tablet server 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017) as failed
I20260429 19:55:58.241988 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.32.67:44017
--local_ip_for_outbound_sockets=127.10.32.67
--tserver_master_addrs=127.10.32.126:36395
--webserver_port=39603
--webserver_interface=127.10.32.67
--builtin_ntp_servers=127.10.32.84:40073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260429 19:55:58.464545 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:58.466713 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:58.466773 13579 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
I20260429 19:55:58.523875 14164 log.cc:826] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Log is configured to *not* fsync() on all Append() calls
W20260429 19:55:58.555038 12217 meta_cache.cc:302] tablet b25d2531d0c044f7b297f7f323e75414: replica 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017) has failed: Network error: Client connection negotiation failed: client connection to 127.10.32.67:44017: connect: Connection refused (error 111)
I20260429 19:55:58.563658 12252 meta_cache.cc:1510] marking tablet server 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017) as failed
W20260429 19:55:58.649115 13579 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:58.674767 14278 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:55:58.675104 14278 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:55:58.675228 14278 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:55:58.684186 14278 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:55:58.684406 14278 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.32.67
I20260429 19:55:58.695194 14278 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.32.67:44017
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.32.67
--webserver_port=39603
--tserver_master_addrs=127.10.32.126:36395
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.32.67
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:55:58.696841 14278 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:55:58.698711 14278 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260429 19:55:58.702857 14278 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260429 19:55:58.709004 14286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:58.708998 14285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:58.710891 14288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:55:58.711663 14278 server_base.cc:1061] running on GCE node
I20260429 19:55:58.712390 14278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 19:55:58.713601 14278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:55:58.714867 14278 hybrid_clock.cc:648] HybridClock initialized: now 1777492558714776 us; error 66 us; skew 500 ppm
I20260429 19:55:58.715207 14278 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:55:58.717514 14278 webserver.cc:492] Webserver started at http://127.10.32.67:39603/ using document root <none> and password file <none>
I20260429 19:55:58.718298 14278 fs_manager.cc:362] Metadata directory not provided
I20260429 19:55:58.718473 14278 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 19:55:58.725149 14278 fs_manager.cc:714] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260429 19:55:58.728652 14294 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:58.730556 14278 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260429 19:55:58.730852 14278 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/wal
uuid: "7c14d1f90d944ae4b2f546d620ec249c"
format_stamp: "Formatted at 2026-04-29 19:55:11 on dist-test-slave-hwg5"
I20260429 19:55:58.731933 14278 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260429 19:55:58.741628 13579 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
W20260429 19:55:58.741652 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
I20260429 19:55:58.763213 14278 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:55:58.764179 14278 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:55:58.764473 14278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:55:58.765539 14278 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 19:55:58.768257 14301 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260429 19:55:58.776841 14278 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260429 19:55:58.777016 14278 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.009s user 0.001s sys 0.000s
I20260429 19:55:58.777149 14278 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260429 19:55:58.780692 14278 ts_tablet_manager.cc:616] Registered 1 tablets
I20260429 19:55:58.780797 14278 ts_tablet_manager.cc:595] Time spent register tablets: real 0.004s user 0.000s sys 0.002s
I20260429 19:55:58.781370 14301 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Bootstrap starting.
W20260429 19:55:58.845199 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
I20260429 19:55:58.857587 14278 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.67:44017
I20260429 19:55:58.857606 14407 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.67:44017 every 8 connection(s)
I20260429 19:55:58.859431 14278 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-2/data/info.pb
I20260429 19:55:58.864831 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 14278
I20260429 19:55:58.865056 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 13537
I20260429 19:55:58.899596 13662 generic_service.cc:196] Checking for leaks (request via RPC)
I20260429 19:55:58.923847 14408 heartbeater.cc:344] Connected to a master server at 127.10.32.126:36395
I20260429 19:55:58.924358 14408 heartbeater.cc:461] Registering TS with master...
I20260429 19:55:58.925879 14408 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:55:58.935467 11625 ts_manager.cc:194] Re-registered known tserver with Master: 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017)
I20260429 19:55:58.937093 11625 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.32.67:33815
I20260429 19:55:58.964821 14271 heartbeater.cc:499] Master 127.10.32.126:36395 was elected leader, sending a full tablet report...
W20260429 19:55:59.146275 13580 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:55318: Illegal state: replica 5fd13bd23da4400b90382adbc6d22955 is not leader of this config: current role FOLLOWER
I20260429 19:55:59.146351 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 13537
W20260429 19:55:59.207000 12219 connection.cc:570] client connection to 127.10.32.65:38215 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260429 19:55:59.207892 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.32.65:38215
--local_ip_for_outbound_sockets=127.10.32.65
--tserver_master_addrs=127.10.32.126:36395
--webserver_port=33319
--webserver_interface=127.10.32.65
--builtin_ntp_servers=127.10.32.84:40073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260429 19:55:59.549786 14301 log.cc:826] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Log is configured to *not* fsync() on all Append() calls
W20260429 19:55:59.609694 12219 meta_cache.cc:302] tablet b25d2531d0c044f7b297f7f323e75414: replica 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215) has failed: Network error: Client connection negotiation failed: client connection to 127.10.32.65:38215: connect: Connection refused (error 111)
I20260429 19:55:59.704526 12251 meta_cache.cc:1510] marking tablet server 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215) as failed
W20260429 19:55:59.740718 14416 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:55:59.741178 14416 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:55:59.741372 14416 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:55:59.755492 14416 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:55:59.755944 14416 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.32.65
I20260429 19:55:59.773233 14416 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.32.65:38215
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.32.65
--webserver_port=33319
--tserver_master_addrs=127.10.32.126:36395
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.32.65
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:55:59.775444 14416 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:55:59.777994 14416 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260429 19:55:59.783826 14416 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260429 19:55:59.790992 14422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:55:59.792879 14423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:55:59.801137 14416 server_base.cc:1061] running on GCE node
W20260429 19:55:59.801576 14425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:55:59.802562 14416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 19:55:59.803876 14416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:55:59.805222 14416 hybrid_clock.cc:648] HybridClock initialized: now 1777492559805133 us; error 59 us; skew 500 ppm
I20260429 19:55:59.805652 14416 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:55:59.808724 14416 webserver.cc:492] Webserver started at http://127.10.32.65:33319/ using document root <none> and password file <none>
I20260429 19:55:59.809837 14416 fs_manager.cc:362] Metadata directory not provided
I20260429 19:55:59.810010 14416 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 19:55:59.818892 14416 fs_manager.cc:714] Time spent opening directory manager: real 0.006s user 0.006s sys 0.000s
I20260429 19:55:59.823272 14431 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:55:59.825280 14416 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260429 19:55:59.825496 14416 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/wal
uuid: "5fd13bd23da4400b90382adbc6d22955"
format_stamp: "Formatted at 2026-04-29 19:55:10 on dist-test-slave-hwg5"
I20260429 19:55:59.826676 14416 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 19:55:59.848039 14416 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:55:59.849421 14416 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:55:59.849774 14416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:55:59.851152 14416 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 19:55:59.854146 14438 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260429 19:55:59.863875 14416 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260429 19:55:59.864113 14416 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.010s user 0.001s sys 0.000s
I20260429 19:55:59.864301 14416 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260429 19:55:59.870106 14438 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Bootstrap starting.
I20260429 19:55:59.874532 14416 ts_tablet_manager.cc:616] Registered 1 tablets
I20260429 19:55:59.874751 14416 ts_tablet_manager.cc:595] Time spent register tablets: real 0.010s user 0.000s sys 0.005s
I20260429 19:55:59.944250 14408 heartbeater.cc:499] Master 127.10.32.126:36395 was elected leader, sending a full tablet report...
I20260429 19:56:00.661172 14544 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.65:38215 every 8 connection(s)
I20260429 19:56:00.661549 14416 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.65:38215
I20260429 19:56:00.663659 14416 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-0/data/info.pb
I20260429 19:56:00.673040 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 14416
I20260429 19:56:00.673273 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 13675
I20260429 19:56:00.706694 14545 heartbeater.cc:344] Connected to a master server at 127.10.32.126:36395
I20260429 19:56:00.707152 14545 heartbeater.cc:461] Registering TS with master...
I20260429 19:56:00.708361 14545 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:56:00.712718 11625 ts_manager.cc:194] Re-registered known tserver with Master: 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215)
I20260429 19:56:00.714304 11625 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.32.65:35975
I20260429 19:56:00.722126 13796 generic_service.cc:196] Checking for leaks (request via RPC)
I20260429 19:56:00.879588 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 13675
W20260429 19:56:00.904884 11613 connection.cc:570] server connection from 127.10.32.68:41343 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260429 19:56:00.906061 10369 external_mini_cluster.cc:1366] Running /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
/tmp/dist-test-tasksFvwcp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.32.68:37785
--local_ip_for_outbound_sockets=127.10.32.68
--tserver_master_addrs=127.10.32.126:36395
--webserver_port=37295
--webserver_interface=127.10.32.68
--builtin_ntp_servers=127.10.32.84:40073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260429 19:56:01.063436 14438 log.cc:826] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Log is configured to *not* fsync() on all Append() calls
W20260429 19:56:01.617223 14553 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 19:56:01.617754 14553 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 19:56:01.617970 14553 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 19:56:01.633790 14553 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 19:56:01.634171 14553 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.32.68
I20260429 19:56:01.652504 14553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.32.84:40073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.32.68:37785
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.10.32.68
--webserver_port=37295
--tserver_master_addrs=127.10.32.126:36395
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.32.68
--log_dir=/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 8537ed5bb5e0e6ac1e481ff961e6b9d08cce7671
build type FASTDEBUG
built by None at 29 Apr 2026 19:43:25 UTC on bdcb31816ec0
build id 11666
ASAN enabled
I20260429 19:56:01.655175 14553 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 19:56:01.657948 14553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260429 19:56:01.664026 14553 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260429 19:56:01.695039 14559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:56:01.701630 14560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 19:56:01.713402 14563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 19:56:01.714634 14553 server_base.cc:1061] running on GCE node
I20260429 19:56:01.715922 14553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 19:56:01.720427 14545 heartbeater.cc:499] Master 127.10.32.126:36395 was elected leader, sending a full tablet report...
I20260429 19:56:01.722838 14553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 19:56:01.726358 14553 hybrid_clock.cc:648] HybridClock initialized: now 1777492561726195 us; error 121 us; skew 500 ppm
I20260429 19:56:01.726969 14553 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260429 19:56:01.745368 14553 webserver.cc:492] Webserver started at http://127.10.32.68:37295/ using document root <none> and password file <none>
I20260429 19:56:01.746964 14553 fs_manager.cc:362] Metadata directory not provided
I20260429 19:56:01.747227 14553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 19:56:01.763200 14553 fs_manager.cc:714] Time spent opening directory manager: real 0.012s user 0.006s sys 0.004s
I20260429 19:56:01.773821 14568 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 19:56:01.776257 14553 fs_manager.cc:730] Time spent opening block manager: real 0.011s user 0.010s sys 0.000s
I20260429 19:56:01.776572 14553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data,/tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/wal
uuid: "25e23c8f6f1d4fc299d315619fcd4021"
format_stamp: "Formatted at 2026-04-29 19:55:12 on dist-test-slave-hwg5"
I20260429 19:56:01.777735 14553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 19:56:01.829531 14553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 19:56:01.830930 14553 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 19:56:01.831333 14553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 19:56:01.839144 14553 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 19:56:01.848753 14553 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260429 19:56:01.848976 14553 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260429 19:56:01.849146 14553 ts_tablet_manager.cc:616] Registered 0 tablets
I20260429 19:56:01.849262 14553 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260429 19:56:02.619788 14553 rpc_server.cc:307] RPC server started. Bound to: 127.10.32.68:37785
I20260429 19:56:02.622299 14553 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0/minicluster-data/ts-3/data/info.pb
I20260429 19:56:02.623050 14680 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.32.68:37785 every 8 connection(s)
I20260429 19:56:02.631578 10369 external_mini_cluster.cc:1428] Started /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu as pid 14553
I20260429 19:56:02.702491 14681 heartbeater.cc:344] Connected to a master server at 127.10.32.126:36395
I20260429 19:56:02.702929 14681 heartbeater.cc:461] Registering TS with master...
I20260429 19:56:02.704155 14681 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:56:02.706219 11625 ts_manager.cc:194] Re-registered known tserver with Master: 25e23c8f6f1d4fc299d315619fcd4021 (127.10.32.68:37785)
I20260429 19:56:02.707341 11625 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.32.68:35453
I20260429 19:56:03.537909 14164 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Bootstrap replaying log segment 1/1 (2.13M/3.74M this segment, stats: ops{read=1233 overwritten=0 applied=1233 ignored=0} inserts{seen=61500 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
I20260429 19:56:03.693360 14480 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260429 19:56:03.694911 14616 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260429 19:56:03.705189 14343 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260429 19:56:03.708942 14206 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260429 19:56:03.718684 14681 heartbeater.cc:499] Master 127.10.32.126:36395 was elected leader, sending a full tablet report...
I20260429 19:56:04.552385 14301 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Bootstrap replaying log segment 1/1 (2.11M/3.71M this segment, stats: ops{read=1222 overwritten=0 applied=1222 ignored=0} inserts{seen=60950 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
I20260429 19:56:06.092998 14438 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Bootstrap replaying log segment 1/1 (2.42M/3.67M this segment, stats: ops{read=1420 overwritten=0 applied=1417 ignored=0} inserts{seen=70700 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
I20260429 19:56:06.616809 12251 scanner-internal.cc:172] Scan of tablet b25d2531d0c044f7b297f7f323e75414 at 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017) deadline exceeded after 10.000s
W20260429 19:56:06.617118 12251 scanner-internal.cc:458] Time spent opening tablet: real 10.939s user 0.012s sys 0.001s
I20260429 19:56:06.786017 12253 scanner-internal.cc:172] Scan of tablet b25d2531d0c044f7b297f7f323e75414 at 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017) deadline exceeded after 10.000s
W20260429 19:56:06.786232 12253 scanner-internal.cc:458] Time spent opening tablet: real 10.964s user 0.013s sys 0.000s
I20260429 19:56:07.083926 12252 scanner-internal.cc:172] Scan of tablet b25d2531d0c044f7b297f7f323e75414 at 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017) deadline exceeded after 10.000s
W20260429 19:56:07.084285 12252 scanner-internal.cc:458] Time spent opening tablet: real 11.135s user 0.013s sys 0.000s
I20260429 19:56:07.398674 14164 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Bootstrap replayed 1/1 log segments. Stats: ops{read=2164 overwritten=0 applied=2164 ignored=0} inserts{seen=108050 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260429 19:56:07.399425 14164 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Bootstrap complete.
I20260429 19:56:07.401501 14164 ts_tablet_manager.cc:1403] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Time spent bootstrapping tablet: real 9.522s user 8.643s sys 0.618s
I20260429 19:56:07.408999 14164 raft_consensus.cc:359] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:56:07.409948 14164 raft_consensus.cc:740] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: c716e625b12e48419e4855fc59197a15, State: Initialized, Role: FOLLOWER
I20260429 19:56:07.410842 14164 consensus_queue.cc:260] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2164, Last appended: 5.2164, Last appended by leader: 2164, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:56:07.412679 14164 ts_tablet_manager.cc:1434] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15: Time spent starting tablet: real 0.011s user 0.009s sys 0.004s
W20260429 19:56:07.493121 14186 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50662: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
W20260429 19:56:07.636075 14186 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50662: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
I20260429 19:56:07.640034 14720 raft_consensus.cc:493] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:56:07.640337 14720 raft_consensus.cc:515] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
W20260429 19:56:07.652341 14186 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50662: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
I20260429 19:56:07.664577 14720 leader_election.cc:290] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215), 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017)
I20260429 19:56:07.686280 14363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "c716e625b12e48419e4855fc59197a15" candidate_term: 7 candidate_status { last_received { term: 5 index: 2164 } } ignore_live_leader: false dest_uuid: "7c14d1f90d944ae4b2f546d620ec249c" is_pre_election: true
W20260429 19:56:07.690124 14158 leader_election.cc:343] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 7 pre-election: Tablet error from VoteRequest() call to peer 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017): Illegal state: must be running to vote when last-logged opid is not known
I20260429 19:56:07.690415 14500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "c716e625b12e48419e4855fc59197a15" candidate_term: 7 candidate_status { last_received { term: 5 index: 2164 } } ignore_live_leader: false dest_uuid: "5fd13bd23da4400b90382adbc6d22955" is_pre_election: true
W20260429 19:56:07.693989 14160 leader_election.cc:343] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 7 pre-election: Tablet error from VoteRequest() call to peer 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215): Illegal state: must be running to vote when last-logged opid is not known
I20260429 19:56:07.694168 14160 leader_election.cc:304] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c716e625b12e48419e4855fc59197a15; no voters: 5fd13bd23da4400b90382adbc6d22955, 7c14d1f90d944ae4b2f546d620ec249c
I20260429 19:56:07.694702 14720 raft_consensus.cc:2749] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260429 19:56:07.982170 14186 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50662: Illegal state: replica c716e625b12e48419e4855fc59197a15 is not leader of this config: current role FOLLOWER
I20260429 19:56:08.063529 14301 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2164 overwritten=0 applied=2164 ignored=0} inserts{seen=108050 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260429 19:56:08.064147 14301 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Bootstrap complete.
I20260429 19:56:08.065634 14301 ts_tablet_manager.cc:1403] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Time spent bootstrapping tablet: real 9.285s user 8.631s sys 0.467s
I20260429 19:56:08.069416 14301 raft_consensus.cc:359] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:56:08.070104 14301 raft_consensus.cc:740] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c14d1f90d944ae4b2f546d620ec249c, State: Initialized, Role: FOLLOWER
I20260429 19:56:08.070820 14301 consensus_queue.cc:260] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2164, Last appended: 5.2164, Last appended by leader: 2164, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:56:08.072472 14301 ts_tablet_manager.cc:1434] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c: Time spent starting tablet: real 0.007s user 0.005s sys 0.004s
I20260429 19:56:08.084117 14720 raft_consensus.cc:493] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 19:56:08.084295 14720 raft_consensus.cc:515] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:56:08.084932 14720 leader_election.cc:290] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215), 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017)
I20260429 19:56:08.085493 14363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "c716e625b12e48419e4855fc59197a15" candidate_term: 7 candidate_status { last_received { term: 5 index: 2164 } } ignore_live_leader: false dest_uuid: "7c14d1f90d944ae4b2f546d620ec249c" is_pre_election: true
I20260429 19:56:08.085502 14500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "c716e625b12e48419e4855fc59197a15" candidate_term: 7 candidate_status { last_received { term: 5 index: 2164 } } ignore_live_leader: false dest_uuid: "5fd13bd23da4400b90382adbc6d22955" is_pre_election: true
I20260429 19:56:08.085891 14363 raft_consensus.cc:2468] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c716e625b12e48419e4855fc59197a15 in term 6.
W20260429 19:56:08.086058 14160 leader_election.cc:343] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 7 pre-election: Tablet error from VoteRequest() call to peer 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215): Illegal state: must be running to vote when last-logged opid is not known
I20260429 19:56:08.086345 14158 leader_election.cc:304] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c14d1f90d944ae4b2f546d620ec249c, c716e625b12e48419e4855fc59197a15; no voters: 5fd13bd23da4400b90382adbc6d22955
I20260429 19:56:08.086647 14720 raft_consensus.cc:2804] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260429 19:56:08.086769 14720 raft_consensus.cc:493] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 19:56:08.086874 14720 raft_consensus.cc:3060] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 6 FOLLOWER]: Advancing to term 7
I20260429 19:56:08.090334 14720 raft_consensus.cc:515] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:56:08.091111 14720 leader_election.cc:290] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 7 election: Requested vote from peers 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215), 7c14d1f90d944ae4b2f546d620ec249c (127.10.32.67:44017)
I20260429 19:56:08.091639 14500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "c716e625b12e48419e4855fc59197a15" candidate_term: 7 candidate_status { last_received { term: 5 index: 2164 } } ignore_live_leader: false dest_uuid: "5fd13bd23da4400b90382adbc6d22955"
I20260429 19:56:08.091735 14363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25d2531d0c044f7b297f7f323e75414" candidate_uuid: "c716e625b12e48419e4855fc59197a15" candidate_term: 7 candidate_status { last_received { term: 5 index: 2164 } } ignore_live_leader: false dest_uuid: "7c14d1f90d944ae4b2f546d620ec249c"
I20260429 19:56:08.091962 14363 raft_consensus.cc:3060] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 6 FOLLOWER]: Advancing to term 7
W20260429 19:56:08.092301 14160 leader_election.cc:343] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 7 election: Tablet error from VoteRequest() call to peer 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215): Illegal state: must be running to vote when last-logged opid is not known
I20260429 19:56:08.095786 14363 raft_consensus.cc:2468] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c716e625b12e48419e4855fc59197a15 in term 7.
I20260429 19:56:08.096364 14158 leader_election.cc:304] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c14d1f90d944ae4b2f546d620ec249c, c716e625b12e48419e4855fc59197a15; no voters: 5fd13bd23da4400b90382adbc6d22955
I20260429 19:56:08.096774 14720 raft_consensus.cc:2804] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 7 FOLLOWER]: Leader election won for term 7
I20260429 19:56:08.097219 14720 raft_consensus.cc:697] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [term 7 LEADER]: Becoming Leader. State: Replica: c716e625b12e48419e4855fc59197a15, State: Running, Role: LEADER
I20260429 19:56:08.097927 14720 consensus_queue.cc:237] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2164, Committed index: 2164, Last appended: 5.2164, Last appended by leader: 2164, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:56:08.103339 11625 catalog_manager.cc:5671] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c716e625b12e48419e4855fc59197a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } health_report { overall_health: UNKNOWN } } }
W20260429 19:56:08.130309 14160 consensus_peers.cc:597] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 -> Peer 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215): Couldn't send request to peer 5fd13bd23da4400b90382adbc6d22955. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260429 19:56:08.130496 14363 raft_consensus.cc:1275] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 7 FOLLOWER]: Refusing update from remote peer c716e625b12e48419e4855fc59197a15: Log matching property violated. Preceding OpId in replica: term: 5 index: 2164. Preceding OpId from leader: term: 7 index: 2166. (index mismatch)
I20260429 19:56:08.131764 14720 consensus_queue.cc:1048] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2165, Last known committed idx: 2164, Time since last communication: 0.000s
I20260429 19:56:08.140847 14732 mvcc.cc:204] Tried to move back new op lower bound from 7280609559051939840 to 7280609558933790720. Current Snapshot: MvccSnapshot[applied={T|T < 7280609559051939840}]
I20260429 19:56:08.150799 14733 mvcc.cc:204] Tried to move back new op lower bound from 7280609559051939840 to 7280609558933790720. Current Snapshot: MvccSnapshot[applied={T|T < 7280609559051939840}]
I20260429 19:56:08.175534 14438 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Bootstrap replayed 1/1 log segments. Stats: ops{read=2163 overwritten=0 applied=2163 ignored=0} inserts{seen=108000 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260429 19:56:08.176154 14438 tablet_bootstrap.cc:492] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Bootstrap complete.
I20260429 19:56:08.178153 14438 ts_tablet_manager.cc:1403] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Time spent bootstrapping tablet: real 8.308s user 7.239s sys 0.626s
I20260429 19:56:08.183674 14438 raft_consensus.cc:359] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:56:08.184506 14438 raft_consensus.cc:740] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fd13bd23da4400b90382adbc6d22955, State: Initialized, Role: FOLLOWER
I20260429 19:56:08.185267 14438 consensus_queue.cc:260] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2163, Last appended: 5.2163, Last appended by leader: 2163, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:56:08.187011 14438 ts_tablet_manager.cc:1434] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955: Time spent starting tablet: real 0.009s user 0.010s sys 0.000s
I20260429 19:56:08.233429 14500 raft_consensus.cc:3060] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 6 FOLLOWER]: Advancing to term 7
I20260429 19:56:08.239240 14500 raft_consensus.cc:1275] T b25d2531d0c044f7b297f7f323e75414 P 5fd13bd23da4400b90382adbc6d22955 [term 7 FOLLOWER]: Refusing update from remote peer c716e625b12e48419e4855fc59197a15: Log matching property violated. Preceding OpId in replica: term: 5 index: 2163. Preceding OpId from leader: term: 5 index: 2164. (index mismatch)
I20260429 19:56:08.240528 14740 consensus_queue.cc:1050] T b25d2531d0c044f7b297f7f323e75414 P c716e625b12e48419e4855fc59197a15 [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2165, Last known committed idx: 2163, Time since last communication: 0.000s
I20260429 19:56:08.263201 14742 mvcc.cc:204] Tried to move back new op lower bound from 7280609559051939840 to 7280609558933790720. Current Snapshot: MvccSnapshot[applied={T|T < 7280609500229603328}]
W20260429 19:56:08.320878 14323 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40132: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:56:08.332715 14323 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40132: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
W20260429 19:56:08.333958 14323 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40132: Illegal state: replica 7c14d1f90d944ae4b2f546d620ec249c is not leader of this config: current role FOLLOWER
I20260429 19:56:10.054564 14616 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260429 19:56:10.109412 14480 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260429 19:56:10.119400 14343 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260429 19:56:10.156423 14206 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260429 19:56:11.435267 11622 ts_manager.cc:284] Unset tserver state for c716e625b12e48419e4855fc59197a15 from MAINTENANCE_MODE
I20260429 19:56:11.740422 14681 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:56:11.890189 11622 ts_manager.cc:284] Unset tserver state for 5fd13bd23da4400b90382adbc6d22955 from MAINTENANCE_MODE
I20260429 19:56:11.898365 11622 ts_manager.cc:284] Unset tserver state for 7c14d1f90d944ae4b2f546d620ec249c from MAINTENANCE_MODE
I20260429 19:56:12.094832 11622 ts_manager.cc:284] Unset tserver state for 25e23c8f6f1d4fc299d315619fcd4021 from MAINTENANCE_MODE
I20260429 19:56:12.157661 14408 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:56:12.312067 14545 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/maintenance_mode-itest.cc:750: Failure
Value of: s.ok()
Actual: true
Expected: false
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260429 19:56:12.326699 14271 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
I20260429 19:56:12.331849 10369 external_mini_cluster-itest-base.cc:80] Found fatal failure
I20260429 19:56:12.332082 10369 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 0 with UUID 5fd13bd23da4400b90382adbc6d22955 and pid 14416
************************ BEGIN STACKS **************************
I20260429 19:56:12.744256 14681 heartbeater.cc:507] Master 127.10.32.126:36395 requested a full tablet report, sending...
[New LWP 14418]
[New LWP 14419]
[New LWP 14420]
[New LWP 14421]
[New LWP 14427]
[New LWP 14428]
[New LWP 14429]
[New LWP 14432]
[New LWP 14433]
[New LWP 14434]
[New LWP 14435]
[New LWP 14436]
[New LWP 14437]
[New LWP 14439]
[New LWP 14440]
[New LWP 14441]
[New LWP 14442]
[New LWP 14443]
[New LWP 14444]
[New LWP 14445]
[New LWP 14446]
[New LWP 14447]
[New LWP 14448]
[New LWP 14449]
[New LWP 14450]
[New LWP 14451]
[New LWP 14452]
[New LWP 14453]
[New LWP 14454]
[New LWP 14455]
[New LWP 14456]
[New LWP 14457]
[New LWP 14458]
[New LWP 14459]
[New LWP 14460]
[New LWP 14461]
[New LWP 14462]
[New LWP 14463]
[New LWP 14464]
[New LWP 14465]
[New LWP 14466]
[New LWP 14467]
[New LWP 14468]
[New LWP 14469]
[New LWP 14470]
[New LWP 14471]
[New LWP 14472]
[New LWP 14473]
[New LWP 14474]
[New LWP 14475]
[New LWP 14476]
[New LWP 14477]
[New LWP 14478]
[New LWP 14479]
[New LWP 14480]
[New LWP 14481]
[New LWP 14482]
[New LWP 14483]
[New LWP 14484]
[New LWP 14485]
[New LWP 14486]
[New LWP 14487]
[New LWP 14488]
[New LWP 14489]
[New LWP 14490]
[New LWP 14491]
[New LWP 14492]
[New LWP 14493]
[New LWP 14494]
[New LWP 14495]
[New LWP 14496]
[New LWP 14497]
[New LWP 14498]
[New LWP 14499]
[New LWP 14500]
[New LWP 14501]
[New LWP 14502]
[New LWP 14503]
[New LWP 14504]
[New LWP 14505]
[New LWP 14506]
[New LWP 14507]
[New LWP 14508]
[New LWP 14509]
[New LWP 14510]
[New LWP 14511]
[New LWP 14512]
[New LWP 14513]
[New LWP 14514]
[New LWP 14515]
[New LWP 14516]
[New LWP 14517]
[New LWP 14518]
[New LWP 14519]
[New LWP 14520]
[New LWP 14521]
[New LWP 14522]
[New LWP 14523]
[New LWP 14524]
[New LWP 14525]
[New LWP 14526]
[New LWP 14527]
[New LWP 14528]
[New LWP 14529]
[New LWP 14530]
[New LWP 14531]
[New LWP 14532]
[New LWP 14533]
[New LWP 14534]
[New LWP 14535]
[New LWP 14536]
[New LWP 14537]
[New LWP 14538]
[New LWP 14539]
[New LWP 14540]
[New LWP 14541]
[New LWP 14542]
[New LWP 14543]
[New LWP 14544]
[New LWP 14545]
[New LWP 14550]
[New LWP 14743]
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f20
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f20
0x00007f16d9282d50 in ?? ()
Id Target Id Frame
* 1 LWP 14416 "kudu" 0x00007f16d9282d50 in ?? ()
2 LWP 14418 "kudu" 0x00007f16d927efb9 in ?? ()
3 LWP 14419 "kudu" 0x00007f16d927efb9 in ?? ()
4 LWP 14420 "kudu" 0x00007f16d927efb9 in ?? ()
5 LWP 14421 "kernel-watcher-" 0x00007f16d927efb9 in ?? ()
6 LWP 14427 "ntp client-1442" 0x00007f16d92829e2 in ?? ()
7 LWP 14428 "file cache-evic" 0x00007f16d927efb9 in ?? ()
8 LWP 14429 "sq_acceptor" 0x00007f16d1db5bb9 in ?? ()
9 LWP 14432 "rpc reactor-144" 0x00007f16d1dc2947 in ?? ()
10 LWP 14433 "rpc reactor-144" 0x00007f16d1dc2947 in ?? ()
11 LWP 14434 "rpc reactor-144" 0x00007f16d1dc2947 in ?? ()
12 LWP 14435 "rpc reactor-144" 0x00007f16d1dc2947 in ?? ()
13 LWP 14436 "MaintenanceMgr " 0x00007f16d927ead3 in ?? ()
14 LWP 14437 "txn-status-mana" 0x00007f16d927efb9 in ?? ()
15 LWP 14439 "collect_and_rem" 0x00007f16d927efb9 in ?? ()
16 LWP 14440 "tc-session-exp-" 0x00007f16d927efb9 in ?? ()
17 LWP 14441 "rpc worker-1444" 0x00007f16d927ead3 in ?? ()
18 LWP 14442 "rpc worker-1444" 0x00007f16d927ead3 in ?? ()
19 LWP 14443 "rpc worker-1444" 0x00007f16d927ead3 in ?? ()
20 LWP 14444 "rpc worker-1444" 0x00007f16d927ead3 in ?? ()
21 LWP 14445 "rpc worker-1444" 0x00007f16d927ead3 in ?? ()
22 LWP 14446 "rpc worker-1444" 0x00007f16d927ead3 in ?? ()
23 LWP 14447 "rpc worker-1444" 0x00007f16d927ead3 in ?? ()
24 LWP 14448 "rpc worker-1444" 0x00007f16d927ead3 in ?? ()
25 LWP 14449 "rpc worker-1444" 0x00007f16d927ead3 in ?? ()
26 LWP 14450 "rpc worker-1445" 0x00007f16d927ead3 in ?? ()
27 LWP 14451 "rpc worker-1445" 0x00007f16d927ead3 in ?? ()
28 LWP 14452 "rpc worker-1445" 0x00007f16d927ead3 in ?? ()
29 LWP 14453 "rpc worker-1445" 0x00007f16d927ead3 in ?? ()
30 LWP 14454 "rpc worker-1445" 0x00007f16d927ead3 in ?? ()
31 LWP 14455 "rpc worker-1445" 0x00007f16d927ead3 in ?? ()
32 LWP 14456 "rpc worker-1445" 0x00007f16d927ead3 in ?? ()
33 LWP 14457 "rpc worker-1445" 0x00007f16d927ead3 in ?? ()
34 LWP 14458 "rpc worker-1445" 0x00007f16d927ead3 in ?? ()
35 LWP 14459 "rpc worker-1445" 0x00007f16d927ead3 in ?? ()
36 LWP 14460 "rpc worker-1446" 0x00007f16d927ead3 in ?? ()
37 LWP 14461 "rpc worker-1446" 0x00007f16d927ead3 in ?? ()
38 LWP 14462 "rpc worker-1446" 0x00007f16d927ead3 in ?? ()
39 LWP 14463 "rpc worker-1446" 0x00007f16d927ead3 in ?? ()
40 LWP 14464 "rpc worker-1446" 0x00007f16d927ead3 in ?? ()
41 LWP 14465 "rpc worker-1446" 0x00007f16d927ead3 in ?? ()
42 LWP 14466 "rpc worker-1446" 0x00007f16d927ead3 in ?? ()
43 LWP 14467 "rpc worker-1446" 0x00007f16d927ead3 in ?? ()
44 LWP 14468 "rpc worker-1446" 0x00007f16d927ead3 in ?? ()
45 LWP 14469 "rpc worker-1446" 0x00007f16d927ead3 in ?? ()
46 LWP 14470 "rpc worker-1447" 0x00007f16d927ead3 in ?? ()
47 LWP 14471 "rpc worker-1447" 0x00007f16d927ead3 in ?? ()
48 LWP 14472 "rpc worker-1447" 0x00007f16d927ead3 in ?? ()
49 LWP 14473 "rpc worker-1447" 0x00007f16d927ead3 in ?? ()
50 LWP 14474 "rpc worker-1447" 0x00007f16d927ead3 in ?? ()
51 LWP 14475 "rpc worker-1447" 0x00007f16d927ead3 in ?? ()
52 LWP 14476 "rpc worker-1447" 0x00007f16d927ead3 in ?? ()
53 LWP 14477 "rpc worker-1447" 0x00007f16d927ead3 in ?? ()
54 LWP 14478 "rpc worker-1447" 0x00007f16d927ead3 in ?? ()
55 LWP 14479 "rpc worker-1447" 0x00007f16d927ead3 in ?? ()
56 LWP 14480 "rpc worker-1448" 0x00007f16d927ead3 in ?? ()
57 LWP 14481 "rpc worker-1448" 0x00007f16d927ead3 in ?? ()
58 LWP 14482 "rpc worker-1448" 0x00007f16d927ead3 in ?? ()
59 LWP 14483 "rpc worker-1448" 0x00007f16d927ead3 in ?? ()
60 LWP 14484 "rpc worker-1448" 0x00007f16d927ead3 in ?? ()
61 LWP 14485 "rpc worker-1448" 0x00007f16d927ead3 in ?? ()
62 LWP 14486 "rpc worker-1448" 0x00007f16d927ead3 in ?? ()
63 LWP 14487 "rpc worker-1448" 0x00007f16d927ead3 in ?? ()
64 LWP 14488 "rpc worker-1448" 0x00007f16d927ead3 in ?? ()
65 LWP 14489 "rpc worker-1448" 0x00007f16d927ead3 in ?? ()
66 LWP 14490 "rpc worker-1449" 0x00007f16d927ead3 in ?? ()
67 LWP 14491 "rpc worker-1449" 0x00007f16d927ead3 in ?? ()
68 LWP 14492 "rpc worker-1449" 0x00007f16d927ead3 in ?? ()
69 LWP 14493 "rpc worker-1449" 0x00007f16d927ead3 in ?? ()
70 LWP 14494 "rpc worker-1449" 0x00007f16d927ead3 in ?? ()
71 LWP 14495 "rpc worker-1449" 0x00007f16d927ead3 in ?? ()
72 LWP 14496 "rpc worker-1449" 0x00007f16d927ead3 in ?? ()
73 LWP 14497 "rpc worker-1449" 0x00007f16d927ead3 in ?? ()
74 LWP 14498 "rpc worker-1449" 0x00007f16d927ead3 in ?? ()
75 LWP 14499 "rpc worker-1449" 0x00007f16d927ead3 in ?? ()
76 LWP 14500 "rpc worker-1450" 0x00007f16d927ead3 in ?? ()
77 LWP 14501 "rpc worker-1450" 0x00007f16d927ead3 in ?? ()
78 LWP 14502 "rpc worker-1450" 0x00007f16d927ead3 in ?? ()
79 LWP 14503 "rpc worker-1450" 0x00007f16d927ead3 in ?? ()
80 LWP 14504 "rpc worker-1450" 0x00007f16d927ead3 in ?? ()
81 LWP 14505 "rpc worker-1450" 0x00007f16d927ead3 in ?? ()
82 LWP 14506 "rpc worker-1450" 0x00007f16d927ead3 in ?? ()
83 LWP 14507 "rpc worker-1450" 0x00007f16d927ead3 in ?? ()
84 LWP 14508 "rpc worker-1450" 0x00007f16d927ead3 in ?? ()
85 LWP 14509 "rpc worker-1450" 0x00007f16d927ead3 in ?? ()
86 LWP 14510 "rpc worker-1451" 0x00007f16d927ead3 in ?? ()
87 LWP 14511 "rpc worker-1451" 0x00007f16d927ead3 in ?? ()
88 LWP 14512 "rpc worker-1451" 0x00007f16d927ead3 in ?? ()
89 LWP 14513 "rpc worker-1451" 0x00007f16d927ead3 in ?? ()
90 LWP 14514 "rpc worker-1451" 0x00007f16d927ead3 in ?? ()
91 LWP 14515 "rpc worker-1451" 0x00007f16d927ead3 in ?? ()
92 LWP 14516 "rpc worker-1451" 0x00007f16d927ead3 in ?? ()
93 LWP 14517 "rpc worker-1451" 0x00007f16d927ead3 in ?? ()
94 LWP 14518 "rpc worker-1451" 0x00007f16d927ead3 in ?? ()
95 LWP 14519 "rpc worker-1451" 0x00007f16d927ead3 in ?? ()
96 LWP 14520 "rpc worker-1452" 0x00007f16d927ead3 in ?? ()
97 LWP 14521 "rpc worker-1452" 0x00007f16d927ead3 in ?? ()
98 LWP 14522 "rpc worker-1452" 0x00007f16d927ead3 in ?? ()
99 LWP 14523 "rpc worker-1452" 0x00007f16d927ead3 in ?? ()
100 LWP 14524 "rpc worker-1452" 0x00007f16d927ead3 in ?? ()
101 LWP 14525 "rpc worker-1452" 0x00007f16d927ead3 in ?? ()
102 LWP 14526 "rpc worker-1452" 0x00007f16d927ead3 in ?? ()
103 LWP 14527 "rpc worker-1452" 0x00007f16d927ead3 in ?? ()
104 LWP 14528 "rpc worker-1452" 0x00007f16d927ead3 in ?? ()
105 LWP 14529 "rpc worker-1452" 0x00007f16d927ead3 in ?? ()
106 LWP 14530 "rpc worker-1453" 0x00007f16d927ead3 in ?? ()
107 LWP 14531 "rpc worker-1453" 0x00007f16d927ead3 in ?? ()
108 LWP 14532 "rpc worker-1453" 0x00007f16d927ead3 in ?? ()
109 LWP 14533 "rpc worker-1453" 0x00007f16d927ead3 in ?? ()
110 LWP 14534 "rpc worker-1453" 0x00007f16d927ead3 in ?? ()
111 LWP 14535 "rpc worker-1453" 0x00007f16d927ead3 in ?? ()
112 LWP 14536 "rpc worker-1453" 0x00007f16d927ead3 in ?? ()
113 LWP 14537 "rpc worker-1453" 0x00007f16d927ead3 in ?? ()
114 LWP 14538 "rpc worker-1453" 0x00007f16d927ead3 in ?? ()
115 LWP 14539 "rpc worker-1453" 0x00007f16d927ead3 in ?? ()
116 LWP 14540 "rpc worker-1454" 0x00007f16d927ead3 in ?? ()
117 LWP 14541 "diag-logger-145" 0x00007f16d927efb9 in ?? ()
118 LWP 14542 "result-tracker-" 0x00007f16d927efb9 in ?? ()
119 LWP 14543 "excess-log-dele" 0x00007f16d927efb9 in ?? ()
120 LWP 14544 "acceptor-14544" 0x00007f16d1dc3fc7 in ?? ()
121 LWP 14545 "heartbeat-14545" 0x00007f16d927efb9 in ?? ()
122 LWP 14550 "maintenance_sch" 0x00007f16d927efb9 in ?? ()
123 LWP 14743 "wal-append [wor" 0x00007f16d927efb9 in ?? ()
Thread 123 (LWP 14743):
#0 0x00007f16d927efb9 in ?? ()
#1 0x0000602000c10c78 in ?? ()
#2 0x00000000000002b7 in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x000061a000396db4 in ?? ()
#5 0x00007f168e02a130 in ?? ()
#6 0x000000000000056f in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007f168e02a150 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x0000000000000000 in ?? ()
Thread 122 (LWP 14550):
#0 0x00007f16d927efb9 in ?? ()
#1 0x00007f168d81b700 in ?? ()
#2 0x0000000000000031 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000616000016ca0 in ?? ()
#5 0x00007f168d81b750 in ?? ()
#6 0x0000000000000062 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 14545):
#0 0x00007f16d927efb9 in ?? ()
#1 0xee0390f6396bc70b in ?? ()
#2 0x000000000000000d in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061300001bfc0 in ?? ()
#5 0x00007f168e842610 in ?? ()
#6 0x000000000000001a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 120 (LWP 14544):
#0 0x00007f16d1dc3fc7 in ?? ()
#1 0x00006140000218a8 in ?? ()
#2 0x00007f168f069d70 in ?? ()
#3 0x00007f168f069da0 in ?? ()
#4 0x00007f168f069ea0 in ?? ()
#5 0x00007f168f069d90 in ?? ()
#6 0x00007f168f069e00 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000008d957b in __sanitizer::theDepot ()
#9 0x0000000500000014 in ?? ()
#10 0x00007f168f069f20 in ?? ()
#11 0x00007f168f06965c in ?? ()
#12 0x000000328f0695d0 in ?? ()
#13 0x00007f168e86d000 in ?? ()
#14 0x0000000000000000 in ?? ()
Thread 119 (LWP 14543):
#0 0x00007f16d927efb9 in ?? ()
#1 0x00007f168f882f60 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 14542):
#0 0x00007f16d927efb9 in ?? ()
#1 0x00007f169009c120 in ?? ()
#2 0x000000000000000c in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100008caf0 in ?? ()
#5 0x00007f169009c110 in ?? ()
#6 0x0000000000000018 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 14541):
#0 0x00007f16d927efb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 14540):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000008 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0002b6848 in ?? ()
#4 0x00007f16910cbeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f16910cbed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 115 (LWP 14539):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 114 (LWP 14538):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 14537):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 14536):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 14535):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 14534):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 14533):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 14532):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 14531):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 14530):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 14529):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 14528):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 14527):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 14526):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 14525):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 14524):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 14523):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 14522):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 14521):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 14520):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 14519):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 14518):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 14517):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 14516):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 14515):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 14514):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 14513):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 14512):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 14511):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 14510):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 14509):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 14508):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 14507):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 14506):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 14505):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 14504):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 14503):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 14502):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 14501):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 14500):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000144 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001ad088 in ?? ()
#4 0x00007f16a54e4eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f16a54e4ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 75 (LWP 14499):
#0 0x00007f16d927ead3 in ?? ()
#1 0x000000000000010d in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a688c in ?? ()
#4 0x00007f16a5cfceb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f16a5cfced0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a6840 in ?? ()
#9 0x00007f16d927e770 in ?? ()
#10 0x00007f16a5cfced0 in ?? ()
#11 0x00007f16a5cfce90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 74 (LWP 14498):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a008c in ?? ()
#4 0x00007f16a6514eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f16a6514ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a0040 in ?? ()
#9 0x00007f16d927e770 in ?? ()
#10 0x00007f16a6514ed0 in ?? ()
#11 0x00007f16a6514e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 73 (LWP 14497):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 14496):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 14495):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 14494):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 14493):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 14492):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 14491):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 14490):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 14489):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 14488):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 14487):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 14486):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 14485):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 14484):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 14483):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 14482):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 14481):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 14480):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d000126838 in ?? ()
#4 0x00007f16aeeadeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f16aeeaded0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 55 (LWP 14479):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 54 (LWP 14478):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 53 (LWP 14477):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 14476):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 14475):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 14474):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 14473):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 14472):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 14471):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 14470):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 14469):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 14468):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 14467):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 14466):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 14465):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 14464):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 14463):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 14462):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 14461):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 14460):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000016 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0000a67e8 in ?? ()
#4 0x00007f16b908eeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f16b908eed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 35 (LWP 14459):
#0 0x00007f16d927ead3 in ?? ()
#1 0x000000000000002a in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00009ffe8 in ?? ()
#4 0x00007f16b98a6eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f16b98a6ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 34 (LWP 14458):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 33 (LWP 14457):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 14456):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 14455):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 14454):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 14453):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 14452):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 14451):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 14450):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 14449):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 14448):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 14447):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 14446):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 14445):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 14444):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 14443):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 14442):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 14441):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 14440):
#0 0x00007f16d927efb9 in ?? ()
#1 0x00007f16c3293ce0 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061300001cf60 in ?? ()
#5 0x00007f16c3293cd0 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 14439):
#0 0x00007f16d927efb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001fe98 in ?? ()
#5 0x00007f16c3acc270 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 14437):
#0 0x00007f16d927efb9 in ?? ()
#1 0x00007f16c4b29260 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061800000c5a8 in ?? ()
#5 0x00007f16c4b29250 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 14436):
#0 0x00007f16d927ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 14435):
#0 0x00007f16d1dc2947 in ?? ()
#1 0x00007f16c5b78340 in ?? ()
#2 0x000061a00000c680 in ?? ()
#3 0x00007f16c5b78330 in ?? ()
#4 0x00007f16c5b78540 in ?? ()
#5 0x00007f16c5b78380 in ?? ()
#6 0x0000614000021e98 in ?? ()
#7 0x00007f16c5b78400 in ?? ()
#8 0x00007f16d443725d in ?? ()
#9 0x3fb9606de51f5000 in ?? ()
#10 0x000061a00000c680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c680 in ?? ()
#13 0x00000000dcbcb3d0 in ?? ()
#14 0x00007f1600000000 in ?? ()
#15 0x41da7c9832a3fe0e in ?? ()
#16 0x00000fe358b67080 in ?? ()
#17 0x00007f16c5b783e0 in ?? ()
#18 0x00007f16d443bba3 in ?? ()
#19 0x00007f16c5b783b0 in ?? ()
#20 0x3fb9606de51f5000 in ?? ()
#21 0x00000000c5b78400 in ?? ()
#22 0x000061a00000c680 in ?? ()
#23 0x0000614000021e98 in ?? ()
#24 0x3fb9606de51f5000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 14434):
#0 0x00007f16d1dc2947 in ?? ()
#1 0x00007f16c638f340 in ?? ()
#2 0x000061a00000c080 in ?? ()
#3 0x00007f16c638f330 in ?? ()
#4 0x00007f16c638f540 in ?? ()
#5 0x00007f16c638f380 in ?? ()
#6 0x0000614000021c98 in ?? ()
#7 0x00007f16c638f400 in ?? ()
#8 0x00007f16d443725d in ?? ()
#9 0x3f9fb49da36e4000 in ?? ()
#10 0x000061a00000c080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c080 in ?? ()
#13 0x00000000dcbcb3d0 in ?? ()
#14 0x00007f1600000000 in ?? ()
#15 0x41da7c9832a3fe11 in ?? ()
#16 0x00000fe358c69e80 in ?? ()
#17 0x00007f16c638f3e0 in ?? ()
#18 0x00007f16d443bba3 in ?? ()
#19 0x00007f16c638f3b0 in ?? ()
#20 0x3f9fb49da36e4000 in ?? ()
#21 0x00000000c638f400 in ?? ()
#22 0x000061a00000c080 in ?? ()
#23 0x0000614000021c98 in ?? ()
#24 0x3f9fb49da36e4000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 14433):
#0 0x00007f16d1dc2947 in ?? ()
#1 0x00007f16c6ba6340 in ?? ()
#2 0x000061a00000ba80 in ?? ()
#3 0x00007f16c6ba6330 in ?? ()
#4 0x00007f16c6ba6540 in ?? ()
#5 0x00007f16c6ba6380 in ?? ()
#6 0x0000614000021a98 in ?? ()
#7 0x00007f16c6ba6400 in ?? ()
#8 0x00007f16d443725d in ?? ()
#9 0x3fb974c5e975d000 in ?? ()
#10 0x000061a00000ba80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ba80 in ?? ()
#13 0x00000000dcbcb3d0 in ?? ()
#14 0x00007f1600000000 in ?? ()
#15 0x41da7c9832a3fe11 in ?? ()
#16 0x00000fe358d6cc80 in ?? ()
#17 0x00007f16c6ba63e0 in ?? ()
#18 0x00007f16d443bba3 in ?? ()
#19 0x00007f16c6ba63b0 in ?? ()
#20 0x3fb974c5e975d000 in ?? ()
#21 0x00000000c6ba6400 in ?? ()
#22 0x000061a00000ba80 in ?? ()
#23 0x0000614000021a98 in ?? ()
#24 0x3fb974c5e975d000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 14432):
#0 0x00007f16d1dc2947 in ?? ()
#1 0x00007f16c8bad340 in ?? ()
#2 0x000061a00000b480 in ?? ()
#3 0x00007f16c8bad330 in ?? ()
#4 0x00007f16c8bad540 in ?? ()
#5 0x00007f16c8bad380 in ?? ()
#6 0x0000614000021898 in ?? ()
#7 0x00007f16c8bad400 in ?? ()
#8 0x00007f16d443725d in ?? ()
#9 0x3fb95221ba2c2000 in ?? ()
#10 0x000061a00000b480 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000b480 in ?? ()
#13 0x00000000dcbcb3d0 in ?? ()
#14 0x00007f1600000000 in ?? ()
#15 0x41da7c9832a3fe11 in ?? ()
#16 0x00000fe35916da80 in ?? ()
#17 0x00007f16c8bad3e0 in ?? ()
#18 0x00007f16d443bba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 14429):
#0 0x00007f16d1db5bb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007f16ca5b77b8 in ?? ()
#3 0x000060200001ea50 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000008d11c1 in __sanitizer::theDepot ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 14428):
#0 0x00007f16d927efb9 in ?? ()
#1 0x00007f16c9db60e0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 14427):
#0 0x00007f16d92829e2 in ?? ()
#1 0x00007f16c95b3bc0 in ?? ()
#2 0x00007f16c95b3c60 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007f16c95b3c10 in ?? ()
#6 0x00000000017d0860 in ?? ()
#7 0x00007f16c95b3c70 in ?? ()
#8 0x000061100008d450 in ?? ()
#9 0x00007f16c95b3c60 in ?? ()
#10 0x00000000008cb6b7 in __sanitizer::theDepot ()
#11 0x00007f16dec2bbfc in ?? ()
#12 0x00007f16dec1b209 in ?? ()
#13 0x00007f16dec1f7f6 in ?? ()
#14 0x00007f16dec24230 in ?? ()
#15 0x00007f16dec24059 in ?? ()
#16 0x0000000000aa4cad in __sanitizer::theDepot ()
#17 0x00007f16d5caa529 in ?? ()
#18 0x00007f16d92786db in ?? ()
#19 0x00000fe3592ae688 in ?? ()
#20 0x00007f16c95b3460 in ?? ()
#21 0x0000000000000000 in ?? ()
Thread 5 (LWP 14421):
#0 0x00007f16d927efb9 in ?? ()
#1 0x00007f16cb5b8ca0 in ?? ()
#2 0x0000000000000042 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200000c728 in ?? ()
#5 0x00007f16cb5b8c90 in ?? ()
#6 0x0000000000000084 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 14420):
#0 0x00007f16d927efb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 14419):
#0 0x00007f16d927efb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 14418):
#0 0x00007f16d927efb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000612000012b38 in ?? ()
#5 0x00007f16ccdbc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 14416):
#0 0x00007f16d9282d50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20260429 19:56:13.104576 10369 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 1 with UUID c716e625b12e48419e4855fc59197a15 and pid 14142
************************ BEGIN STACKS **************************
[New LWP 14144]
[New LWP 14145]
[New LWP 14146]
[New LWP 14147]
[New LWP 14153]
[New LWP 14154]
[New LWP 14155]
[New LWP 14158]
[New LWP 14159]
[New LWP 14160]
[New LWP 14161]
[New LWP 14162]
[New LWP 14163]
[New LWP 14165]
[New LWP 14166]
[New LWP 14167]
[New LWP 14168]
[New LWP 14169]
[New LWP 14170]
[New LWP 14171]
[New LWP 14172]
[New LWP 14173]
[New LWP 14174]
[New LWP 14175]
[New LWP 14176]
[New LWP 14177]
[New LWP 14178]
[New LWP 14179]
[New LWP 14180]
[New LWP 14181]
[New LWP 14182]
[New LWP 14183]
[New LWP 14184]
[New LWP 14185]
[New LWP 14186]
[New LWP 14187]
[New LWP 14188]
[New LWP 14189]
[New LWP 14190]
[New LWP 14191]
[New LWP 14192]
[New LWP 14193]
[New LWP 14194]
[New LWP 14195]
[New LWP 14196]
[New LWP 14197]
[New LWP 14198]
[New LWP 14199]
[New LWP 14200]
[New LWP 14201]
[New LWP 14202]
[New LWP 14203]
[New LWP 14204]
[New LWP 14205]
[New LWP 14206]
[New LWP 14207]
[New LWP 14208]
[New LWP 14209]
[New LWP 14210]
[New LWP 14211]
[New LWP 14212]
[New LWP 14213]
[New LWP 14214]
[New LWP 14215]
[New LWP 14216]
[New LWP 14217]
[New LWP 14218]
[New LWP 14219]
[New LWP 14220]
[New LWP 14221]
[New LWP 14222]
[New LWP 14223]
[New LWP 14224]
[New LWP 14225]
[New LWP 14226]
[New LWP 14227]
[New LWP 14228]
[New LWP 14229]
[New LWP 14230]
[New LWP 14231]
[New LWP 14232]
[New LWP 14233]
[New LWP 14234]
[New LWP 14235]
[New LWP 14236]
[New LWP 14237]
[New LWP 14238]
[New LWP 14239]
[New LWP 14240]
[New LWP 14241]
[New LWP 14242]
[New LWP 14243]
[New LWP 14244]
[New LWP 14245]
[New LWP 14246]
[New LWP 14247]
[New LWP 14248]
[New LWP 14249]
[New LWP 14250]
[New LWP 14251]
[New LWP 14252]
[New LWP 14253]
[New LWP 14254]
[New LWP 14255]
[New LWP 14256]
[New LWP 14257]
[New LWP 14258]
[New LWP 14259]
[New LWP 14260]
[New LWP 14261]
[New LWP 14262]
[New LWP 14263]
[New LWP 14264]
[New LWP 14265]
[New LWP 14266]
[New LWP 14267]
[New LWP 14268]
[New LWP 14269]
[New LWP 14270]
[New LWP 14271]
[New LWP 14272]
[New LWP 14720]
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f20
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f20
0x00007f39999fdd50 in ?? ()
Id Target Id Frame
* 1 LWP 14142 "kudu" 0x00007f39999fdd50 in ?? ()
2 LWP 14144 "kudu" 0x00007f39999f9fb9 in ?? ()
3 LWP 14145 "kudu" 0x00007f39999f9fb9 in ?? ()
4 LWP 14146 "kudu" 0x00007f39999f9fb9 in ?? ()
5 LWP 14147 "kernel-watcher-" 0x00007f39999f9fb9 in ?? ()
6 LWP 14153 "ntp client-1415" 0x00007f39999fd9e2 in ?? ()
7 LWP 14154 "file cache-evic" 0x00007f39999f9fb9 in ?? ()
8 LWP 14155 "sq_acceptor" 0x00007f3992530bb9 in ?? ()
9 LWP 14158 "rpc reactor-141" 0x00007f399253d947 in ?? ()
10 LWP 14159 "rpc reactor-141" 0x00007f399253d947 in ?? ()
11 LWP 14160 "rpc reactor-141" 0x00007f399253d947 in ?? ()
12 LWP 14161 "rpc reactor-141" 0x00007f399253d947 in ?? ()
13 LWP 14162 "MaintenanceMgr " 0x00007f39999f9ad3 in ?? ()
14 LWP 14163 "txn-status-mana" 0x00007f39999f9fb9 in ?? ()
15 LWP 14165 "collect_and_rem" 0x00007f39999f9fb9 in ?? ()
16 LWP 14166 "tc-session-exp-" 0x00007f39999f9fb9 in ?? ()
17 LWP 14167 "rpc worker-1416" 0x00007f39999f9ad3 in ?? ()
18 LWP 14168 "rpc worker-1416" 0x00007f39999f9ad3 in ?? ()
19 LWP 14169 "rpc worker-1416" 0x00007f39999f9ad3 in ?? ()
20 LWP 14170 "rpc worker-1417" 0x00007f39999f9ad3 in ?? ()
21 LWP 14171 "rpc worker-1417" 0x00007f39999f9ad3 in ?? ()
22 LWP 14172 "rpc worker-1417" 0x00007f39999f9ad3 in ?? ()
23 LWP 14173 "rpc worker-1417" 0x00007f39999f9ad3 in ?? ()
24 LWP 14174 "rpc worker-1417" 0x00007f39999f9ad3 in ?? ()
25 LWP 14175 "rpc worker-1417" 0x00007f39999f9ad3 in ?? ()
26 LWP 14176 "rpc worker-1417" 0x00007f39999f9ad3 in ?? ()
27 LWP 14177 "rpc worker-1417" 0x00007f39999f9ad3 in ?? ()
28 LWP 14178 "rpc worker-1417" 0x00007f39999f9ad3 in ?? ()
29 LWP 14179 "rpc worker-1417" 0x00007f39999f9ad3 in ?? ()
30 LWP 14180 "rpc worker-1418" 0x00007f39999f9ad3 in ?? ()
31 LWP 14181 "rpc worker-1418" 0x00007f39999f9ad3 in ?? ()
32 LWP 14182 "rpc worker-1418" 0x00007f39999f9ad3 in ?? ()
33 LWP 14183 "rpc worker-1418" 0x00007f39999f9ad3 in ?? ()
34 LWP 14184 "rpc worker-1418" 0x00007f39999f9ad3 in ?? ()
35 LWP 14185 "rpc worker-1418" 0x00007f39999f9ad3 in ?? ()
36 LWP 14186 "rpc worker-1418" 0x00007f39999f9ad3 in ?? ()
37 LWP 14187 "rpc worker-1418" 0x00007f39999f9ad3 in ?? ()
38 LWP 14188 "rpc worker-1418" 0x00007f39999f9ad3 in ?? ()
39 LWP 14189 "rpc worker-1418" 0x00007f39999f9ad3 in ?? ()
40 LWP 14190 "rpc worker-1419" 0x00007f39999f9ad3 in ?? ()
41 LWP 14191 "rpc worker-1419" 0x00007f39999f9ad3 in ?? ()
42 LWP 14192 "rpc worker-1419" 0x00007f39999f9ad3 in ?? ()
43 LWP 14193 "rpc worker-1419" 0x00007f39999f9ad3 in ?? ()
44 LWP 14194 "rpc worker-1419" 0x00007f39999f9ad3 in ?? ()
45 LWP 14195 "rpc worker-1419" 0x00007f39999f9ad3 in ?? ()
46 LWP 14196 "rpc worker-1419" 0x00007f39999f9ad3 in ?? ()
47 LWP 14197 "rpc worker-1419" 0x00007f39999f9ad3 in ?? ()
48 LWP 14198 "rpc worker-1419" 0x00007f39999f9ad3 in ?? ()
49 LWP 14199 "rpc worker-1419" 0x00007f39999f9ad3 in ?? ()
50 LWP 14200 "rpc worker-1420" 0x00007f39999f9ad3 in ?? ()
51 LWP 14201 "rpc worker-1420" 0x00007f39999f9ad3 in ?? ()
52 LWP 14202 "rpc worker-1420" 0x00007f39999f9ad3 in ?? ()
53 LWP 14203 "rpc worker-1420" 0x00007f39999f9ad3 in ?? ()
54 LWP 14204 "rpc worker-1420" 0x00007f39999f9ad3 in ?? ()
55 LWP 14205 "rpc worker-1420" 0x00007f39999f9ad3 in ?? ()
56 LWP 14206 "rpc worker-1420" 0x00007f39999f9ad3 in ?? ()
57 LWP 14207 "rpc worker-1420" 0x00007f39999f9ad3 in ?? ()
58 LWP 14208 "rpc worker-1420" 0x00007f39999f9ad3 in ?? ()
59 LWP 14209 "rpc worker-1420" 0x00007f39999f9ad3 in ?? ()
60 LWP 14210 "rpc worker-1421" 0x00007f39999f9ad3 in ?? ()
61 LWP 14211 "rpc worker-1421" 0x00007f39999f9ad3 in ?? ()
62 LWP 14212 "rpc worker-1421" 0x00007f39999f9ad3 in ?? ()
63 LWP 14213 "rpc worker-1421" 0x00007f39999f9ad3 in ?? ()
64 LWP 14214 "rpc worker-1421" 0x00007f39999f9ad3 in ?? ()
65 LWP 14215 "rpc worker-1421" 0x00007f39999f9ad3 in ?? ()
66 LWP 14216 "rpc worker-1421" 0x00007f39999f9ad3 in ?? ()
67 LWP 14217 "rpc worker-1421" 0x00007f39999f9ad3 in ?? ()
68 LWP 14218 "rpc worker-1421" 0x00007f39999f9ad3 in ?? ()
69 LWP 14219 "rpc worker-1421" 0x00007f39999f9ad3 in ?? ()
70 LWP 14220 "rpc worker-1422" 0x00007f39999f9ad3 in ?? ()
71 LWP 14221 "rpc worker-1422" 0x00007f39999f9ad3 in ?? ()
72 LWP 14222 "rpc worker-1422" 0x00007f39999f9ad3 in ?? ()
73 LWP 14223 "rpc worker-1422" 0x00007f39999f9ad3 in ?? ()
74 LWP 14224 "rpc worker-1422" 0x00007f39999f9ad3 in ?? ()
75 LWP 14225 "rpc worker-1422" 0x00007f39999f9ad3 in ?? ()
76 LWP 14226 "rpc worker-1422" 0x00007f39999f9ad3 in ?? ()
77 LWP 14227 "rpc worker-1422" 0x00007f39999f9ad3 in ?? ()
78 LWP 14228 "rpc worker-1422" 0x00007f39999f9ad3 in ?? ()
79 LWP 14229 "rpc worker-1422" 0x00007f39999f9ad3 in ?? ()
80 LWP 14230 "rpc worker-1423" 0x00007f39999f9ad3 in ?? ()
81 LWP 14231 "rpc worker-1423" 0x00007f39999f9ad3 in ?? ()
82 LWP 14232 "rpc worker-1423" 0x00007f39999f9ad3 in ?? ()
83 LWP 14233 "rpc worker-1423" 0x00007f39999f9ad3 in ?? ()
84 LWP 14234 "rpc worker-1423" 0x00007f39999f9ad3 in ?? ()
85 LWP 14235 "rpc worker-1423" 0x00007f39999f9ad3 in ?? ()
86 LWP 14236 "rpc worker-1423" 0x00007f39999f9ad3 in ?? ()
87 LWP 14237 "rpc worker-1423" 0x00007f39999f9ad3 in ?? ()
88 LWP 14238 "rpc worker-1423" 0x00007f39999f9ad3 in ?? ()
89 LWP 14239 "rpc worker-1423" 0x00007f39999f9ad3 in ?? ()
90 LWP 14240 "rpc worker-1424" 0x00007f39999f9ad3 in ?? ()
91 LWP 14241 "rpc worker-1424" 0x00007f39999f9ad3 in ?? ()
92 LWP 14242 "rpc worker-1424" 0x00007f39999f9ad3 in ?? ()
93 LWP 14243 "rpc worker-1424" 0x00007f39999f9ad3 in ?? ()
94 LWP 14244 "rpc worker-1424" 0x00007f39999f9ad3 in ?? ()
95 LWP 14245 "rpc worker-1424" 0x00007f39999f9ad3 in ?? ()
96 LWP 14246 "rpc worker-1424" 0x00007f39999f9ad3 in ?? ()
97 LWP 14247 "rpc worker-1424" 0x00007f39999f9ad3 in ?? ()
98 LWP 14248 "rpc worker-1424" 0x00007f39999f9ad3 in ?? ()
99 LWP 14249 "rpc worker-1424" 0x00007f39999f9ad3 in ?? ()
100 LWP 14250 "rpc worker-1425" 0x00007f39999f9ad3 in ?? ()
101 LWP 14251 "rpc worker-1425" 0x00007f39999f9ad3 in ?? ()
102 LWP 14252 "rpc worker-1425" 0x00007f39999f9ad3 in ?? ()
103 LWP 14253 "rpc worker-1425" 0x00007f39999f9ad3 in ?? ()
104 LWP 14254 "rpc worker-1425" 0x00007f39999f9ad3 in ?? ()
105 LWP 14255 "rpc worker-1425" 0x00007f39999f9ad3 in ?? ()
106 LWP 14256 "rpc worker-1425" 0x00007f39999f9ad3 in ?? ()
107 LWP 14257 "rpc worker-1425" 0x00007f39999f9ad3 in ?? ()
108 LWP 14258 "rpc worker-1425" 0x00007f39999f9ad3 in ?? ()
109 LWP 14259 "rpc worker-1425" 0x00007f39999f9ad3 in ?? ()
110 LWP 14260 "rpc worker-1426" 0x00007f39999f9ad3 in ?? ()
111 LWP 14261 "rpc worker-1426" 0x00007f39999f9ad3 in ?? ()
112 LWP 14262 "rpc worker-1426" 0x00007f39999f9ad3 in ?? ()
113 LWP 14263 "rpc worker-1426" 0x00007f39999f9ad3 in ?? ()
114 LWP 14264 "rpc worker-1426" 0x00007f39999f9ad3 in ?? ()
115 LWP 14265 "rpc worker-1426" 0x00007f39999f9ad3 in ?? ()
116 LWP 14266 "rpc worker-1426" 0x00007f39999f9ad3 in ?? ()
117 LWP 14267 "diag-logger-142" 0x00007f39999f9fb9 in ?? ()
118 LWP 14268 "result-tracker-" 0x00007f39999f9fb9 in ?? ()
119 LWP 14269 "excess-log-dele" 0x00007f39999f9fb9 in ?? ()
120 LWP 14270 "acceptor-14270" 0x00007f399253efc7 in ?? ()
121 LWP 14271 "heartbeat-14271" 0x00007f39999f9fb9 in ?? ()
122 LWP 14272 "maintenance_sch" 0x00007f39999f9fb9 in ?? ()
123 LWP 14720 "raft [worker]-1" 0x00007f39999f9fb9 in ?? ()
Thread 123 (LWP 14720):
#0 0x00007f39999f9fb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x00000000000001e4 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00007f394d7bdbc0 in ?? ()
#5 0x00007f394d7bd850 in ?? ()
#6 0x00000000000003c8 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 122 (LWP 14272):
#0 0x00007f39999f9fb9 in ?? ()
#1 0x00007f394dfd5700 in ?? ()
#2 0x000000000000003f in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000616000016ca0 in ?? ()
#5 0x00007f394dfd5750 in ?? ()
#6 0x000000000000007e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 14271):
#0 0x00007f39999f9fb9 in ?? ()
#1 0xee0390f6396bc70b in ?? ()
#2 0x0000000000000012 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061300001bfc0 in ?? ()
#5 0x00007f394e7ed610 in ?? ()
#6 0x0000000000000024 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 120 (LWP 14270):
#0 0x00007f399253efc7 in ?? ()
#1 0x0000614000021ca8 in ?? ()
#2 0x00007f394f014d70 in ?? ()
#3 0x00007f394f014da0 in ?? ()
#4 0x00007f394f014ea0 in ?? ()
#5 0x00007f394f014d90 in ?? ()
#6 0x00007f394f014e00 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000008d957b in __sanitizer::theDepot ()
#9 0x0000000500000014 in ?? ()
#10 0x00007f394f014f20 in ?? ()
#11 0x00007f394f01465c in ?? ()
#12 0x000000324f0145d0 in ?? ()
#13 0x00007f394e818000 in ?? ()
#14 0x0000000000000000 in ?? ()
Thread 119 (LWP 14269):
#0 0x00007f39999f9fb9 in ?? ()
#1 0x00007f394f82df60 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 14268):
#0 0x00007f39999f9fb9 in ?? ()
#1 0x00007f3950047120 in ?? ()
#2 0x000000000000000f in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100008caf0 in ?? ()
#5 0x00007f3950047110 in ?? ()
#6 0x000000000000001e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 14267):
#0 0x00007f39999f9fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 14266):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000008 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0002b6848 in ?? ()
#4 0x00007f3951076eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f3951076ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 115 (LWP 14265):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 114 (LWP 14264):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 14263):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 14262):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 14261):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 14260):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 14259):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 14258):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 14257):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 14256):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 14255):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 14254):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 14253):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 14252):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 14251):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 14250):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 14249):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 14248):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 14247):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 14246):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 14245):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 14244):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 14243):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 14242):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 14241):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 14240):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 14239):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 14238):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 14237):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 14236):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 14235):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 14234):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 14233):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 14232):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 14231):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 14230):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 14229):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 14228):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 14227):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 14226):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001ad088 in ?? ()
#4 0x00007f3965447eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f3965447ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 75 (LWP 14225):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 74 (LWP 14224):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 73 (LWP 14223):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 14222):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 14221):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 14220):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 14219):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 14218):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 14217):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 14216):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 14215):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 14214):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 14213):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 14212):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 14211):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 14210):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 14209):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 14208):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 14207):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 14206):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d000126838 in ?? ()
#4 0x00007f396f628eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f396f628ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 55 (LWP 14205):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 54 (LWP 14204):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 53 (LWP 14203):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 14202):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 14201):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 14200):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 14199):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 14198):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 14197):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 14196):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 14195):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 14194):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 14193):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 14192):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 14191):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 14190):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 14189):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 14188):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 14187):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 14186):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x00000000000000eb in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0000a67ec in ?? ()
#4 0x00007f3979809eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f3979809ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000a67a0 in ?? ()
#9 0x00007f39999f9770 in ?? ()
#10 0x00007f3979809ed0 in ?? ()
#11 0x00007f3979809e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 35 (LWP 14185):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000113 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00009ffec in ?? ()
#4 0x00007f397a021eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f397a021ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00009ffa0 in ?? ()
#9 0x00007f39999f9770 in ?? ()
#10 0x00007f397a021ed0 in ?? ()
#11 0x00007f397a021e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 34 (LWP 14184):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 33 (LWP 14183):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 14182):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 14181):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 14180):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 14179):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 14178):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 14177):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 14176):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 14175):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 14174):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 14173):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 14172):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 14171):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 14170):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 14169):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 14168):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 14167):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 14166):
#0 0x00007f39999f9fb9 in ?? ()
#1 0x00007f39839b7ce0 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061300001cf60 in ?? ()
#5 0x00007f39839b7cd0 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 14165):
#0 0x00007f39999f9fb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000003 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001fe98 in ?? ()
#5 0x00007f39841b9270 in ?? ()
#6 0x0000000000000006 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 14163):
#0 0x00007f39999f9fb9 in ?? ()
#1 0x00007f39851ba260 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061800000c5a8 in ?? ()
#5 0x00007f39851ba250 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 14162):
#0 0x00007f39999f9ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 14161):
#0 0x00007f399253d947 in ?? ()
#1 0x00007f39861bd340 in ?? ()
#2 0x000061a00000c680 in ?? ()
#3 0x00007f39861bd330 in ?? ()
#4 0x00007f39861bd540 in ?? ()
#5 0x00007f39861bd380 in ?? ()
#6 0x0000614000021e98 in ?? ()
#7 0x00007f39861bd400 in ?? ()
#8 0x00007f3994bb225d in ?? ()
#9 0x3fb0e646639e4000 in ?? ()
#10 0x000061a00000c680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c680 in ?? ()
#13 0x000000009d3463d0 in ?? ()
#14 0x00007f3900000000 in ?? ()
#15 0x41da7c9832a3fe10 in ?? ()
#16 0x00000fe7b0c2fa80 in ?? ()
#17 0x00007f39861bd3e0 in ?? ()
#18 0x00007f3994bb6ba3 in ?? ()
#19 0x00007f39861bd3b0 in ?? ()
#20 0x3fb0e646639e4000 in ?? ()
#21 0x00000000861bd400 in ?? ()
#22 0x000061a00000c680 in ?? ()
#23 0x0000614000021e98 in ?? ()
#24 0x3fb0e646639e4000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 14160):
#0 0x00007f399253d947 in ?? ()
#1 0x00007f39869be340 in ?? ()
#2 0x000061a00000c080 in ?? ()
#3 0x00007f39869be330 in ?? ()
#4 0x00007f39869be540 in ?? ()
#5 0x00007f39869be380 in ?? ()
#6 0x0000614000021c98 in ?? ()
#7 0x00007f39869be400 in ?? ()
#8 0x00007f3994bb225d in ?? ()
#9 0x3fb95b9e76d21000 in ?? ()
#10 0x000061a00000c080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c080 in ?? ()
#13 0x000000009d3463d0 in ?? ()
#14 0x00007f3900000000 in ?? ()
#15 0x41da7c9832a3fe11 in ?? ()
#16 0x00000fe7b0d2fc80 in ?? ()
#17 0x00007f39869be3e0 in ?? ()
#18 0x00007f3994bb6ba3 in ?? ()
#19 0x00007f39869be3b0 in ?? ()
#20 0x3fb95b9e76d21000 in ?? ()
#21 0x00000000869be400 in ?? ()
#22 0x000061a00000c080 in ?? ()
#23 0x0000614000021c98 in ?? ()
#24 0x3fb95b9e76d21000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 14159):
#0 0x00007f399253d947 in ?? ()
#1 0x00007f39871bf340 in ?? ()
#2 0x000061a00000ba80 in ?? ()
#3 0x00007f39871bf330 in ?? ()
#4 0x00007f39871bf540 in ?? ()
#5 0x00007f39871bf380 in ?? ()
#6 0x0000614000021a98 in ?? ()
#7 0x00007f39871bf400 in ?? ()
#8 0x00007f3994bb225d in ?? ()
#9 0x3fa6d7ebb9cd0000 in ?? ()
#10 0x000061a00000ba80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ba80 in ?? ()
#13 0x000000009d3463d0 in ?? ()
#14 0x00007f3900000000 in ?? ()
#15 0x41da7c9832a3fe13 in ?? ()
#16 0x00000fe7b0e2fe80 in ?? ()
#17 0x00007f39871bf3e0 in ?? ()
#18 0x00007f3994bb6ba3 in ?? ()
#19 0x00007f39871bf3b0 in ?? ()
#20 0x3fa6d7ebb9cd0000 in ?? ()
#21 0x00000000871bf400 in ?? ()
#22 0x000061a00000ba80 in ?? ()
#23 0x0000614000021a98 in ?? ()
#24 0x3fa6d7ebb9cd0000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 14158):
#0 0x00007f399253d947 in ?? ()
#1 0x00007f3988da3340 in ?? ()
#2 0x000061a00000b480 in ?? ()
#3 0x00007f3988da3330 in ?? ()
#4 0x00007f3988da3540 in ?? ()
#5 0x00007f3988da3380 in ?? ()
#6 0x0000614000021898 in ?? ()
#7 0x00007f3988da3400 in ?? ()
#8 0x00007f3994bb225d in ?? ()
#9 0x3fb06424cb482000 in ?? ()
#10 0x000061a00000b480 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000b480 in ?? ()
#13 0x000000009d3463d0 in ?? ()
#14 0x00007f3900000000 in ?? ()
#15 0x41da7c9832a3fe13 in ?? ()
#16 0x00000fe7b11ac680 in ?? ()
#17 0x00007f3988da33e0 in ?? ()
#18 0x00007f3994bb6ba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 14155):
#0 0x00007f3992530bb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007f398adb77b8 in ?? ()
#3 0x0000602000020510 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000008d11c1 in __sanitizer::theDepot ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 14154):
#0 0x00007f39999f9fb9 in ?? ()
#1 0x00007f398a5b60e0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 14153):
#0 0x00007f39999fd9e2 in ?? ()
#1 0x00007f3989db3bc0 in ?? ()
#2 0x00007f3989db3c60 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007f3989db3c10 in ?? ()
#6 0x00000000017d0860 in ?? ()
#7 0x00007f3989db3c70 in ?? ()
#8 0x000061100008d450 in ?? ()
#9 0x00007f3989db3c60 in ?? ()
#10 0x00000000008cb6b7 in __sanitizer::theDepot ()
#11 0x00007f399f3a6bfc in ?? ()
#12 0x00007f399f396209 in ?? ()
#13 0x00007f399f39a7f6 in ?? ()
#14 0x00007f399f39f230 in ?? ()
#15 0x00007f399f39f059 in ?? ()
#16 0x0000000000aa4cad in __sanitizer::theDepot ()
#17 0x00007f3996425529 in ?? ()
#18 0x00007f39999f36db in ?? ()
#19 0x00000fe7b13ae688 in ?? ()
#20 0x00007f3989db3460 in ?? ()
#21 0x0000000000000000 in ?? ()
Thread 5 (LWP 14147):
#0 0x00007f39999f9fb9 in ?? ()
#1 0x00007f398bdb8ca0 in ?? ()
#2 0x000000000000004f in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200000c728 in ?? ()
#5 0x00007f398bdb8c90 in ?? ()
#6 0x000000000000009e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 14146):
#0 0x00007f39999f9fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 14145):
#0 0x00007f39999f9fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 14144):
#0 0x00007f39999f9fb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000612000012b38 in ?? ()
#5 0x00007f398d5bc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 14142):
#0 0x00007f39999fdd50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20260429 19:56:13.872071 10369 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 2 with UUID 7c14d1f90d944ae4b2f546d620ec249c and pid 14278
************************ BEGIN STACKS **************************
[New LWP 14281]
[New LWP 14282]
[New LWP 14283]
[New LWP 14284]
[New LWP 14290]
[New LWP 14291]
[New LWP 14292]
[New LWP 14295]
[New LWP 14296]
[New LWP 14297]
[New LWP 14298]
[New LWP 14299]
[New LWP 14300]
[New LWP 14302]
[New LWP 14303]
[New LWP 14304]
[New LWP 14305]
[New LWP 14306]
[New LWP 14307]
[New LWP 14308]
[New LWP 14309]
[New LWP 14310]
[New LWP 14311]
[New LWP 14312]
[New LWP 14313]
[New LWP 14314]
[New LWP 14315]
[New LWP 14316]
[New LWP 14317]
[New LWP 14318]
[New LWP 14319]
[New LWP 14320]
[New LWP 14321]
[New LWP 14322]
[New LWP 14323]
[New LWP 14324]
[New LWP 14325]
[New LWP 14326]
[New LWP 14327]
[New LWP 14328]
[New LWP 14329]
[New LWP 14330]
[New LWP 14331]
[New LWP 14332]
[New LWP 14333]
[New LWP 14334]
[New LWP 14335]
[New LWP 14336]
[New LWP 14337]
[New LWP 14338]
[New LWP 14339]
[New LWP 14340]
[New LWP 14341]
[New LWP 14342]
[New LWP 14343]
[New LWP 14344]
[New LWP 14345]
[New LWP 14346]
[New LWP 14347]
[New LWP 14348]
[New LWP 14349]
[New LWP 14350]
[New LWP 14351]
[New LWP 14352]
[New LWP 14353]
[New LWP 14354]
[New LWP 14355]
[New LWP 14356]
[New LWP 14357]
[New LWP 14358]
[New LWP 14359]
[New LWP 14360]
[New LWP 14361]
[New LWP 14362]
[New LWP 14363]
[New LWP 14364]
[New LWP 14365]
[New LWP 14366]
[New LWP 14367]
[New LWP 14368]
[New LWP 14369]
[New LWP 14370]
[New LWP 14371]
[New LWP 14372]
[New LWP 14373]
[New LWP 14374]
[New LWP 14375]
[New LWP 14376]
[New LWP 14377]
[New LWP 14378]
[New LWP 14379]
[New LWP 14380]
[New LWP 14381]
[New LWP 14382]
[New LWP 14383]
[New LWP 14384]
[New LWP 14385]
[New LWP 14386]
[New LWP 14387]
[New LWP 14388]
[New LWP 14389]
[New LWP 14390]
[New LWP 14391]
[New LWP 14392]
[New LWP 14393]
[New LWP 14394]
[New LWP 14395]
[New LWP 14396]
[New LWP 14397]
[New LWP 14398]
[New LWP 14399]
[New LWP 14400]
[New LWP 14401]
[New LWP 14402]
[New LWP 14403]
[New LWP 14404]
[New LWP 14405]
[New LWP 14406]
[New LWP 14407]
[New LWP 14408]
[New LWP 14409]
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f20
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f20
0x00007f80501b6d50 in ?? ()
Id Target Id Frame
* 1 LWP 14278 "kudu" 0x00007f80501b6d50 in ?? ()
2 LWP 14281 "kudu" 0x00007f80501b2fb9 in ?? ()
3 LWP 14282 "kudu" 0x00007f80501b2fb9 in ?? ()
4 LWP 14283 "kudu" 0x00007f80501b2fb9 in ?? ()
5 LWP 14284 "kernel-watcher-" 0x00007f80501b2fb9 in ?? ()
6 LWP 14290 "ntp client-1429" 0x00007f80501b69e2 in ?? ()
7 LWP 14291 "file cache-evic" 0x00007f80501b2fb9 in ?? ()
8 LWP 14292 "sq_acceptor" 0x00007f8048ce9bb9 in ?? ()
9 LWP 14295 "rpc reactor-142" 0x00007f8048cf6947 in ?? ()
10 LWP 14296 "rpc reactor-142" 0x00007f8048cf6947 in ?? ()
11 LWP 14297 "rpc reactor-142" 0x00007f8048cf6947 in ?? ()
12 LWP 14298 "rpc reactor-142" 0x00007f8048cf6947 in ?? ()
13 LWP 14299 "MaintenanceMgr " 0x00007f80501b2ad3 in ?? ()
14 LWP 14300 "txn-status-mana" 0x00007f80501b2fb9 in ?? ()
15 LWP 14302 "collect_and_rem" 0x00007f80501b2fb9 in ?? ()
16 LWP 14303 "tc-session-exp-" 0x00007f80501b2fb9 in ?? ()
17 LWP 14304 "rpc worker-1430" 0x00007f80501b2ad3 in ?? ()
18 LWP 14305 "rpc worker-1430" 0x00007f80501b2ad3 in ?? ()
19 LWP 14306 "rpc worker-1430" 0x00007f80501b2ad3 in ?? ()
20 LWP 14307 "rpc worker-1430" 0x00007f80501b2ad3 in ?? ()
21 LWP 14308 "rpc worker-1430" 0x00007f80501b2ad3 in ?? ()
22 LWP 14309 "rpc worker-1430" 0x00007f80501b2ad3 in ?? ()
23 LWP 14310 "rpc worker-1431" 0x00007f80501b2ad3 in ?? ()
24 LWP 14311 "rpc worker-1431" 0x00007f80501b2ad3 in ?? ()
25 LWP 14312 "rpc worker-1431" 0x00007f80501b2ad3 in ?? ()
26 LWP 14313 "rpc worker-1431" 0x00007f80501b2ad3 in ?? ()
27 LWP 14314 "rpc worker-1431" 0x00007f80501b2ad3 in ?? ()
28 LWP 14315 "rpc worker-1431" 0x00007f80501b2ad3 in ?? ()
29 LWP 14316 "rpc worker-1431" 0x00007f80501b2ad3 in ?? ()
30 LWP 14317 "rpc worker-1431" 0x00007f80501b2ad3 in ?? ()
31 LWP 14318 "rpc worker-1431" 0x00007f80501b2ad3 in ?? ()
32 LWP 14319 "rpc worker-1431" 0x00007f80501b2ad3 in ?? ()
33 LWP 14320 "rpc worker-1432" 0x00007f80501b2ad3 in ?? ()
34 LWP 14321 "rpc worker-1432" 0x00007f80501b2ad3 in ?? ()
35 LWP 14322 "rpc worker-1432" 0x00007f80501b2ad3 in ?? ()
36 LWP 14323 "rpc worker-1432" 0x00007f80501b2ad3 in ?? ()
37 LWP 14324 "rpc worker-1432" 0x00007f80501b2ad3 in ?? ()
38 LWP 14325 "rpc worker-1432" 0x00007f80501b2ad3 in ?? ()
39 LWP 14326 "rpc worker-1432" 0x00007f80501b2ad3 in ?? ()
40 LWP 14327 "rpc worker-1432" 0x00007f80501b2ad3 in ?? ()
41 LWP 14328 "rpc worker-1432" 0x00007f80501b2ad3 in ?? ()
42 LWP 14329 "rpc worker-1432" 0x00007f80501b2ad3 in ?? ()
43 LWP 14330 "rpc worker-1433" 0x00007f80501b2ad3 in ?? ()
44 LWP 14331 "rpc worker-1433" 0x00007f80501b2ad3 in ?? ()
45 LWP 14332 "rpc worker-1433" 0x00007f80501b2ad3 in ?? ()
46 LWP 14333 "rpc worker-1433" 0x00007f80501b2ad3 in ?? ()
47 LWP 14334 "rpc worker-1433" 0x00007f80501b2ad3 in ?? ()
48 LWP 14335 "rpc worker-1433" 0x00007f80501b2ad3 in ?? ()
49 LWP 14336 "rpc worker-1433" 0x00007f80501b2ad3 in ?? ()
50 LWP 14337 "rpc worker-1433" 0x00007f80501b2ad3 in ?? ()
51 LWP 14338 "rpc worker-1433" 0x00007f80501b2ad3 in ?? ()
52 LWP 14339 "rpc worker-1433" 0x00007f80501b2ad3 in ?? ()
53 LWP 14340 "rpc worker-1434" 0x00007f80501b2ad3 in ?? ()
54 LWP 14341 "rpc worker-1434" 0x00007f80501b2ad3 in ?? ()
55 LWP 14342 "rpc worker-1434" 0x00007f80501b2ad3 in ?? ()
56 LWP 14343 "rpc worker-1434" 0x00007f80501b2ad3 in ?? ()
57 LWP 14344 "rpc worker-1434" 0x00007f80501b2ad3 in ?? ()
58 LWP 14345 "rpc worker-1434" 0x00007f80501b2ad3 in ?? ()
59 LWP 14346 "rpc worker-1434" 0x00007f80501b2ad3 in ?? ()
60 LWP 14347 "rpc worker-1434" 0x00007f80501b2ad3 in ?? ()
61 LWP 14348 "rpc worker-1434" 0x00007f80501b2ad3 in ?? ()
62 LWP 14349 "rpc worker-1434" 0x00007f80501b2ad3 in ?? ()
63 LWP 14350 "rpc worker-1435" 0x00007f80501b2ad3 in ?? ()
64 LWP 14351 "rpc worker-1435" 0x00007f80501b2ad3 in ?? ()
65 LWP 14352 "rpc worker-1435" 0x00007f80501b2ad3 in ?? ()
66 LWP 14353 "rpc worker-1435" 0x00007f80501b2ad3 in ?? ()
67 LWP 14354 "rpc worker-1435" 0x00007f80501b2ad3 in ?? ()
68 LWP 14355 "rpc worker-1435" 0x00007f80501b2ad3 in ?? ()
69 LWP 14356 "rpc worker-1435" 0x00007f80501b2ad3 in ?? ()
70 LWP 14357 "rpc worker-1435" 0x00007f80501b2ad3 in ?? ()
71 LWP 14358 "rpc worker-1435" 0x00007f80501b2ad3 in ?? ()
72 LWP 14359 "rpc worker-1435" 0x00007f80501b2ad3 in ?? ()
73 LWP 14360 "rpc worker-1436" 0x00007f80501b2ad3 in ?? ()
74 LWP 14361 "rpc worker-1436" 0x00007f80501b2ad3 in ?? ()
75 LWP 14362 "rpc worker-1436" 0x00007f80501b2ad3 in ?? ()
76 LWP 14363 "rpc worker-1436" 0x00007f80501b2ad3 in ?? ()
77 LWP 14364 "rpc worker-1436" 0x00007f80501b2ad3 in ?? ()
78 LWP 14365 "rpc worker-1436" 0x00007f80501b2ad3 in ?? ()
79 LWP 14366 "rpc worker-1436" 0x00007f80501b2ad3 in ?? ()
80 LWP 14367 "rpc worker-1436" 0x00007f80501b2ad3 in ?? ()
81 LWP 14368 "rpc worker-1436" 0x00007f80501b2ad3 in ?? ()
82 LWP 14369 "rpc worker-1436" 0x00007f80501b2ad3 in ?? ()
83 LWP 14370 "rpc worker-1437" 0x00007f80501b2ad3 in ?? ()
84 LWP 14371 "rpc worker-1437" 0x00007f80501b2ad3 in ?? ()
85 LWP 14372 "rpc worker-1437" 0x00007f80501b2ad3 in ?? ()
86 LWP 14373 "rpc worker-1437" 0x00007f80501b2ad3 in ?? ()
87 LWP 14374 "rpc worker-1437" 0x00007f80501b2ad3 in ?? ()
88 LWP 14375 "rpc worker-1437" 0x00007f80501b2ad3 in ?? ()
89 LWP 14376 "rpc worker-1437" 0x00007f80501b2ad3 in ?? ()
90 LWP 14377 "rpc worker-1437" 0x00007f80501b2ad3 in ?? ()
91 LWP 14378 "rpc worker-1437" 0x00007f80501b2ad3 in ?? ()
92 LWP 14379 "rpc worker-1437" 0x00007f80501b2ad3 in ?? ()
93 LWP 14380 "rpc worker-1438" 0x00007f80501b2ad3 in ?? ()
94 LWP 14381 "rpc worker-1438" 0x00007f80501b2ad3 in ?? ()
95 LWP 14382 "rpc worker-1438" 0x00007f80501b2ad3 in ?? ()
96 LWP 14383 "rpc worker-1438" 0x00007f80501b2ad3 in ?? ()
97 LWP 14384 "rpc worker-1438" 0x00007f80501b2ad3 in ?? ()
98 LWP 14385 "rpc worker-1438" 0x00007f80501b2ad3 in ?? ()
99 LWP 14386 "rpc worker-1438" 0x00007f80501b2ad3 in ?? ()
100 LWP 14387 "rpc worker-1438" 0x00007f80501b2ad3 in ?? ()
101 LWP 14388 "rpc worker-1438" 0x00007f80501b2ad3 in ?? ()
102 LWP 14389 "rpc worker-1438" 0x00007f80501b2ad3 in ?? ()
103 LWP 14390 "rpc worker-1439" 0x00007f80501b2ad3 in ?? ()
104 LWP 14391 "rpc worker-1439" 0x00007f80501b2ad3 in ?? ()
105 LWP 14392 "rpc worker-1439" 0x00007f80501b2ad3 in ?? ()
106 LWP 14393 "rpc worker-1439" 0x00007f80501b2ad3 in ?? ()
107 LWP 14394 "rpc worker-1439" 0x00007f80501b2ad3 in ?? ()
108 LWP 14395 "rpc worker-1439" 0x00007f80501b2ad3 in ?? ()
109 LWP 14396 "rpc worker-1439" 0x00007f80501b2ad3 in ?? ()
110 LWP 14397 "rpc worker-1439" 0x00007f80501b2ad3 in ?? ()
111 LWP 14398 "rpc worker-1439" 0x00007f80501b2ad3 in ?? ()
112 LWP 14399 "rpc worker-1439" 0x00007f80501b2ad3 in ?? ()
113 LWP 14400 "rpc worker-1440" 0x00007f80501b2ad3 in ?? ()
114 LWP 14401 "rpc worker-1440" 0x00007f80501b2ad3 in ?? ()
115 LWP 14402 "rpc worker-1440" 0x00007f80501b2ad3 in ?? ()
116 LWP 14403 "rpc worker-1440" 0x00007f80501b2ad3 in ?? ()
117 LWP 14404 "diag-logger-144" 0x00007f80501b2fb9 in ?? ()
118 LWP 14405 "result-tracker-" 0x00007f80501b2fb9 in ?? ()
119 LWP 14406 "excess-log-dele" 0x00007f80501b2fb9 in ?? ()
120 LWP 14407 "acceptor-14407" 0x00007f8048cf7fc7 in ?? ()
121 LWP 14408 "heartbeat-14408" 0x00007f80501b2fb9 in ?? ()
122 LWP 14409 "maintenance_sch" 0x00007f80501b2fb9 in ?? ()
Thread 122 (LWP 14409):
#0 0x00007f80501b2fb9 in ?? ()
#1 0x00007f800478e700 in ?? ()
#2 0x000000000000003e in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000616000016ca0 in ?? ()
#5 0x00007f800478e750 in ?? ()
#6 0x000000000000007c in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 14408):
#0 0x00007f80501b2fb9 in ?? ()
#1 0xee0390f6396bc70b in ?? ()
#2 0x0000000000000012 in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x000061300001bfc4 in ?? ()
#5 0x00007f8004fa6610 in ?? ()
#6 0x0000000000000025 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007f8004fa6630 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x00007f8004fa66b0 in ?? ()
#12 0x00000ff0009f4cd8 in ?? ()
#13 0x0000000000000000 in ?? ()
Thread 120 (LWP 14407):
#0 0x00007f8048cf7fc7 in ?? ()
#1 0x00006140000218a8 in ?? ()
#2 0x00007f80057cdd70 in ?? ()
#3 0x00007f80057cdda0 in ?? ()
#4 0x00007f80057cdea0 in ?? ()
#5 0x00007f80057cdd90 in ?? ()
#6 0x00007f80057cde00 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000008d957b in __sanitizer::theDepot ()
#9 0x0000000500000014 in ?? ()
#10 0x00007f80057cdf20 in ?? ()
#11 0x00007f80057cd65c in ?? ()
#12 0x00000032057cd5d0 in ?? ()
#13 0x00007f8004fd1000 in ?? ()
#14 0x0000000000000000 in ?? ()
Thread 119 (LWP 14406):
#0 0x00007f80501b2fb9 in ?? ()
#1 0x00007f8005fe6f60 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 14405):
#0 0x00007f80501b2fb9 in ?? ()
#1 0x00007f8006800120 in ?? ()
#2 0x000000000000000f in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100008caf0 in ?? ()
#5 0x00007f8006800110 in ?? ()
#6 0x000000000000001e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 14404):
#0 0x00007f80501b2fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 14403):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000008 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0002b6848 in ?? ()
#4 0x00007f800782feb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f800782fed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 115 (LWP 14402):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 114 (LWP 14401):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 14400):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 14399):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 14398):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 14397):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 14396):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 14395):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 14394):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 14393):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 14392):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 14391):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 14390):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 14389):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 14388):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 14387):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 14386):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 14385):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 14384):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 14383):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 14382):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 14381):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 14380):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 14379):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 14378):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 14377):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 14376):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 14375):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 14374):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 14373):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 14372):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 14371):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 14370):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 14369):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 14368):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 14367):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 14366):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 14365):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 14364):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 14363):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x00000000000000dc in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001ad088 in ?? ()
#4 0x00007f801bc00eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f801bc00ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 75 (LWP 14362):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000144 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a6888 in ?? ()
#4 0x00007f801c418eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f801c418ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 74 (LWP 14361):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000047 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a008c in ?? ()
#4 0x00007f801cc30eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f801cc30ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a0040 in ?? ()
#9 0x00007f80501b2770 in ?? ()
#10 0x00007f801cc30ed0 in ?? ()
#11 0x00007f801cc30e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 73 (LWP 14360):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 14359):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 14358):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 14357):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 14356):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 14355):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 14354):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 14353):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 14352):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 14351):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 14350):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 14349):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 14348):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 14347):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 14346):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 14345):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 14344):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 14343):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d000126838 in ?? ()
#4 0x00007f8025de2eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f8025de2ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 55 (LWP 14342):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 54 (LWP 14341):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 53 (LWP 14340):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 14339):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 14338):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 14337):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 14336):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 14335):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 14334):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 14333):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 14332):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 14331):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 14330):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 14329):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 14328):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 14327):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 14326):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 14325):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 14324):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 14323):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x000000000000003d in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0000a67ec in ?? ()
#4 0x00007f802ffc2eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f802ffc2ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000a67a0 in ?? ()
#9 0x00007f80501b2770 in ?? ()
#10 0x00007f802ffc2ed0 in ?? ()
#11 0x00007f802ffc2e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 35 (LWP 14322):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000019 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00009ffec in ?? ()
#4 0x00007f80307daeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f80307daed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00009ffa0 in ?? ()
#9 0x00007f80501b2770 in ?? ()
#10 0x00007f80307daed0 in ?? ()
#11 0x00007f80307dae90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 34 (LWP 14321):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 33 (LWP 14320):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 14319):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 14318):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 14317):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 14316):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 14315):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 14314):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 14313):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 14312):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 14311):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 14310):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 14309):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 14308):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 14307):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 14306):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 14305):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 14304):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 14303):
#0 0x00007f80501b2fb9 in ?? ()
#1 0x00007f803a1d6ce0 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061300001cf60 in ?? ()
#5 0x00007f803a1d6cd0 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 14302):
#0 0x00007f80501b2fb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000003 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001fe98 in ?? ()
#5 0x00007f803aa0e270 in ?? ()
#6 0x0000000000000006 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 14300):
#0 0x00007f80501b2fb9 in ?? ()
#1 0x00007f803ba5b260 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061800000c5a8 in ?? ()
#5 0x00007f803ba5b250 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 14299):
#0 0x00007f80501b2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 14298):
#0 0x00007f8048cf6947 in ?? ()
#1 0x00007f803caaa340 in ?? ()
#2 0x000061a00000c680 in ?? ()
#3 0x00007f803caaa330 in ?? ()
#4 0x00007f803caaa540 in ?? ()
#5 0x00007f803caaa380 in ?? ()
#6 0x0000614000021e98 in ?? ()
#7 0x00007f803caaa400 in ?? ()
#8 0x00007f804b36b25d in ?? ()
#9 0x3fb269e6bd52a000 in ?? ()
#10 0x000061a00000c680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c680 in ?? ()
#13 0x0000000053aff3d0 in ?? ()
#14 0x00007f8000000000 in ?? ()
#15 0x41da7c9832a3fe13 in ?? ()
#16 0x00000ff08794d480 in ?? ()
#17 0x00007f803caaa3e0 in ?? ()
#18 0x00007f804b36fba3 in ?? ()
#19 0x00007f803caaa3b0 in ?? ()
#20 0x3fb269e6bd52a000 in ?? ()
#21 0x000000003caaa400 in ?? ()
#22 0x000061a00000c680 in ?? ()
#23 0x0000614000021e98 in ?? ()
#24 0x3fb269e6bd52a000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 14297):
#0 0x00007f8048cf6947 in ?? ()
#1 0x00007f803d2b3340 in ?? ()
#2 0x000061a00000c080 in ?? ()
#3 0x00007f803d2b3330 in ?? ()
#4 0x00007f803d2b3540 in ?? ()
#5 0x00007f803d2b3380 in ?? ()
#6 0x0000614000021c98 in ?? ()
#7 0x00007f803d2b3400 in ?? ()
#8 0x00007f804b36b25d in ?? ()
#9 0x3fb96f2fd2737000 in ?? ()
#10 0x000061a00000c080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c080 in ?? ()
#13 0x0000000053aff3d0 in ?? ()
#14 0x00007f8000000000 in ?? ()
#15 0x41da7c9832a3fe12 in ?? ()
#16 0x00000ff087a4e680 in ?? ()
#17 0x00007f803d2b33e0 in ?? ()
#18 0x00007f804b36fba3 in ?? ()
#19 0x00007f803d2b33b0 in ?? ()
#20 0x3fb96f2fd2737000 in ?? ()
#21 0x000000003d2b3400 in ?? ()
#22 0x000061a00000c080 in ?? ()
#23 0x0000614000021c98 in ?? ()
#24 0x3fb96f2fd2737000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 14296):
#0 0x00007f8048cf6947 in ?? ()
#1 0x00007f803dab4340 in ?? ()
#2 0x000061a00000ba80 in ?? ()
#3 0x00007f803dab4330 in ?? ()
#4 0x00007f803dab4540 in ?? ()
#5 0x00007f803dab4380 in ?? ()
#6 0x0000614000021a98 in ?? ()
#7 0x00007f803dab4400 in ?? ()
#8 0x00007f804b36b25d in ?? ()
#9 0x3fb962bef8380000 in ?? ()
#10 0x000061a00000ba80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ba80 in ?? ()
#13 0x0000000053aff3d0 in ?? ()
#14 0x00007f8000000000 in ?? ()
#15 0x41da7c9832a3fe12 in ?? ()
#16 0x00000ff087b4e880 in ?? ()
#17 0x00007f803dab43e0 in ?? ()
#18 0x00007f804b36fba3 in ?? ()
#19 0x00007f803dab43b0 in ?? ()
#20 0x3fb962bef8380000 in ?? ()
#21 0x000000003dab4400 in ?? ()
#22 0x000061a00000ba80 in ?? ()
#23 0x0000614000021a98 in ?? ()
#24 0x3fb962bef8380000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 14295):
#0 0x00007f8048cf6947 in ?? ()
#1 0x00007f803faad340 in ?? ()
#2 0x000061a00000b480 in ?? ()
#3 0x00007f803faad330 in ?? ()
#4 0x00007f803faad540 in ?? ()
#5 0x00007f803faad380 in ?? ()
#6 0x0000614000021898 in ?? ()
#7 0x00007f803faad400 in ?? ()
#8 0x00007f804b36b25d in ?? ()
#9 0x3fb94a3884152000 in ?? ()
#10 0x000061a00000b480 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000b480 in ?? ()
#13 0x0000000053aff3d0 in ?? ()
#14 0x00007f8000000000 in ?? ()
#15 0x41da7c9832a3fe12 in ?? ()
#16 0x00000ff087f4da80 in ?? ()
#17 0x00007f803faad3e0 in ?? ()
#18 0x00007f804b36fba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 14292):
#0 0x00007f8048ce9bb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007f80414b77b8 in ?? ()
#3 0x000060200001d790 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000008d11c1 in __sanitizer::theDepot ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 14291):
#0 0x00007f80501b2fb9 in ?? ()
#1 0x00007f8040cb60e0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 14290):
#0 0x00007f80501b69e2 in ?? ()
#1 0x00007f80404b3bc0 in ?? ()
#2 0x00007f80404b3c60 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007f80404b3c10 in ?? ()
#6 0x00000000017d0860 in ?? ()
#7 0x00007f80404b3c70 in ?? ()
#8 0x000061100008d450 in ?? ()
#9 0x00007f80404b3c60 in ?? ()
#10 0x00000000008cb6b7 in __sanitizer::theDepot ()
#11 0x00007f8055b5fbfc in ?? ()
#12 0x00007f8055b4f209 in ?? ()
#13 0x00007f8055b537f6 in ?? ()
#14 0x00007f8055b58230 in ?? ()
#15 0x00007f8055b58059 in ?? ()
#16 0x0000000000aa4cad in __sanitizer::theDepot ()
#17 0x00007f804cbde529 in ?? ()
#18 0x00007f80501ac6db in ?? ()
#19 0x00000ff08808e688 in ?? ()
#20 0x00007f80404b3460 in ?? ()
#21 0x0000000000000000 in ?? ()
Thread 5 (LWP 14284):
#0 0x00007f80501b2fb9 in ?? ()
#1 0x00007f80424b8ca0 in ?? ()
#2 0x000000000000004f in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200000c728 in ?? ()
#5 0x00007f80424b8c90 in ?? ()
#6 0x000000000000009e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 14283):
#0 0x00007f80501b2fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 14282):
#0 0x00007f80501b2fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 14281):
#0 0x00007f80501b2fb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000612000012b38 in ?? ()
#5 0x00007f8043cbc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 14278):
#0 0x00007f80501b6d50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20260429 19:56:14.638047 10369 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 3 with UUID 25e23c8f6f1d4fc299d315619fcd4021 and pid 14553
************************ BEGIN STACKS **************************
[New LWP 14555]
[New LWP 14556]
[New LWP 14557]
[New LWP 14558]
[New LWP 14564]
[New LWP 14565]
[New LWP 14566]
[New LWP 14569]
[New LWP 14570]
[New LWP 14571]
[New LWP 14572]
[New LWP 14573]
[New LWP 14574]
[New LWP 14575]
[New LWP 14576]
[New LWP 14577]
[New LWP 14578]
[New LWP 14579]
[New LWP 14580]
[New LWP 14581]
[New LWP 14582]
[New LWP 14583]
[New LWP 14584]
[New LWP 14585]
[New LWP 14586]
[New LWP 14587]
[New LWP 14588]
[New LWP 14589]
[New LWP 14590]
[New LWP 14591]
[New LWP 14592]
[New LWP 14593]
[New LWP 14594]
[New LWP 14595]
[New LWP 14596]
[New LWP 14597]
[New LWP 14598]
[New LWP 14599]
[New LWP 14600]
[New LWP 14601]
[New LWP 14602]
[New LWP 14603]
[New LWP 14604]
[New LWP 14605]
[New LWP 14606]
[New LWP 14607]
[New LWP 14608]
[New LWP 14609]
[New LWP 14610]
[New LWP 14611]
[New LWP 14612]
[New LWP 14613]
[New LWP 14614]
[New LWP 14615]
[New LWP 14616]
[New LWP 14617]
[New LWP 14618]
[New LWP 14619]
[New LWP 14620]
[New LWP 14621]
[New LWP 14622]
[New LWP 14623]
[New LWP 14624]
[New LWP 14625]
[New LWP 14626]
[New LWP 14627]
[New LWP 14628]
[New LWP 14629]
[New LWP 14630]
[New LWP 14631]
[New LWP 14632]
[New LWP 14633]
[New LWP 14634]
[New LWP 14635]
[New LWP 14636]
[New LWP 14637]
[New LWP 14638]
[New LWP 14639]
[New LWP 14640]
[New LWP 14641]
[New LWP 14642]
[New LWP 14643]
[New LWP 14644]
[New LWP 14645]
[New LWP 14646]
[New LWP 14647]
[New LWP 14648]
[New LWP 14649]
[New LWP 14650]
[New LWP 14651]
[New LWP 14652]
[New LWP 14653]
[New LWP 14654]
[New LWP 14655]
[New LWP 14656]
[New LWP 14657]
[New LWP 14658]
[New LWP 14659]
[New LWP 14660]
[New LWP 14661]
[New LWP 14662]
[New LWP 14663]
[New LWP 14664]
[New LWP 14665]
[New LWP 14666]
[New LWP 14667]
[New LWP 14668]
[New LWP 14669]
[New LWP 14670]
[New LWP 14671]
[New LWP 14672]
[New LWP 14673]
[New LWP 14674]
[New LWP 14675]
[New LWP 14676]
[New LWP 14677]
[New LWP 14678]
[New LWP 14679]
[New LWP 14680]
[New LWP 14681]
[New LWP 14684]
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f20
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f20
0x00007f15f7344d50 in ?? ()
Id Target Id Frame
* 1 LWP 14553 "kudu" 0x00007f15f7344d50 in ?? ()
2 LWP 14555 "kudu" 0x00007f15f7340fb9 in ?? ()
3 LWP 14556 "kudu" 0x00007f15f7340fb9 in ?? ()
4 LWP 14557 "kudu" 0x00007f15f7340fb9 in ?? ()
5 LWP 14558 "kernel-watcher-" 0x00007f15f7340fb9 in ?? ()
6 LWP 14564 "ntp client-1456" 0x00007f15f73449e2 in ?? ()
7 LWP 14565 "file cache-evic" 0x00007f15f7340fb9 in ?? ()
8 LWP 14566 "sq_acceptor" 0x00007f15efe77bb9 in ?? ()
9 LWP 14569 "rpc reactor-145" 0x00007f15efe84947 in ?? ()
10 LWP 14570 "rpc reactor-145" 0x00007f15efe84947 in ?? ()
11 LWP 14571 "rpc reactor-145" 0x00007f15efe84947 in ?? ()
12 LWP 14572 "rpc reactor-145" 0x00007f15efe84947 in ?? ()
13 LWP 14573 "MaintenanceMgr " 0x00007f15f7340ad3 in ?? ()
14 LWP 14574 "txn-status-mana" 0x00007f15f7340fb9 in ?? ()
15 LWP 14575 "collect_and_rem" 0x00007f15f7340fb9 in ?? ()
16 LWP 14576 "tc-session-exp-" 0x00007f15f7340fb9 in ?? ()
17 LWP 14577 "rpc worker-1457" 0x00007f15f7340ad3 in ?? ()
18 LWP 14578 "rpc worker-1457" 0x00007f15f7340ad3 in ?? ()
19 LWP 14579 "rpc worker-1457" 0x00007f15f7340ad3 in ?? ()
20 LWP 14580 "rpc worker-1458" 0x00007f15f7340ad3 in ?? ()
21 LWP 14581 "rpc worker-1458" 0x00007f15f7340ad3 in ?? ()
22 LWP 14582 "rpc worker-1458" 0x00007f15f7340ad3 in ?? ()
23 LWP 14583 "rpc worker-1458" 0x00007f15f7340ad3 in ?? ()
24 LWP 14584 "rpc worker-1458" 0x00007f15f7340ad3 in ?? ()
25 LWP 14585 "rpc worker-1458" 0x00007f15f7340ad3 in ?? ()
26 LWP 14586 "rpc worker-1458" 0x00007f15f7340ad3 in ?? ()
27 LWP 14587 "rpc worker-1458" 0x00007f15f7340ad3 in ?? ()
28 LWP 14588 "rpc worker-1458" 0x00007f15f7340ad3 in ?? ()
29 LWP 14589 "rpc worker-1458" 0x00007f15f7340ad3 in ?? ()
30 LWP 14590 "rpc worker-1459" 0x00007f15f7340ad3 in ?? ()
31 LWP 14591 "rpc worker-1459" 0x00007f15f7340ad3 in ?? ()
32 LWP 14592 "rpc worker-1459" 0x00007f15f7340ad3 in ?? ()
33 LWP 14593 "rpc worker-1459" 0x00007f15f7340ad3 in ?? ()
34 LWP 14594 "rpc worker-1459" 0x00007f15f7340ad3 in ?? ()
35 LWP 14595 "rpc worker-1459" 0x00007f15f7340ad3 in ?? ()
36 LWP 14596 "rpc worker-1459" 0x00007f15f7340ad3 in ?? ()
37 LWP 14597 "rpc worker-1459" 0x00007f15f7340ad3 in ?? ()
38 LWP 14598 "rpc worker-1459" 0x00007f15f7340ad3 in ?? ()
39 LWP 14599 "rpc worker-1459" 0x00007f15f7340ad3 in ?? ()
40 LWP 14600 "rpc worker-1460" 0x00007f15f7340ad3 in ?? ()
41 LWP 14601 "rpc worker-1460" 0x00007f15f7340ad3 in ?? ()
42 LWP 14602 "rpc worker-1460" 0x00007f15f7340ad3 in ?? ()
43 LWP 14603 "rpc worker-1460" 0x00007f15f7340ad3 in ?? ()
44 LWP 14604 "rpc worker-1460" 0x00007f15f7340ad3 in ?? ()
45 LWP 14605 "rpc worker-1460" 0x00007f15f7340ad3 in ?? ()
46 LWP 14606 "rpc worker-1460" 0x00007f15f7340ad3 in ?? ()
47 LWP 14607 "rpc worker-1460" 0x00007f15f7340ad3 in ?? ()
48 LWP 14608 "rpc worker-1460" 0x00007f15f7340ad3 in ?? ()
49 LWP 14609 "rpc worker-1460" 0x00007f15f7340ad3 in ?? ()
50 LWP 14610 "rpc worker-1461" 0x00007f15f7340ad3 in ?? ()
51 LWP 14611 "rpc worker-1461" 0x00007f15f7340ad3 in ?? ()
52 LWP 14612 "rpc worker-1461" 0x00007f15f7340ad3 in ?? ()
53 LWP 14613 "rpc worker-1461" 0x00007f15f7340ad3 in ?? ()
54 LWP 14614 "rpc worker-1461" 0x00007f15f7340ad3 in ?? ()
55 LWP 14615 "rpc worker-1461" 0x00007f15f7340ad3 in ?? ()
56 LWP 14616 "rpc worker-1461" 0x00007f15f7340ad3 in ?? ()
57 LWP 14617 "rpc worker-1461" 0x00007f15f7340ad3 in ?? ()
58 LWP 14618 "rpc worker-1461" 0x00007f15f7340ad3 in ?? ()
59 LWP 14619 "rpc worker-1461" 0x00007f15f7340ad3 in ?? ()
60 LWP 14620 "rpc worker-1462" 0x00007f15f7340ad3 in ?? ()
61 LWP 14621 "rpc worker-1462" 0x00007f15f7340ad3 in ?? ()
62 LWP 14622 "rpc worker-1462" 0x00007f15f7340ad3 in ?? ()
63 LWP 14623 "rpc worker-1462" 0x00007f15f7340ad3 in ?? ()
64 LWP 14624 "rpc worker-1462" 0x00007f15f7340ad3 in ?? ()
65 LWP 14625 "rpc worker-1462" 0x00007f15f7340ad3 in ?? ()
66 LWP 14626 "rpc worker-1462" 0x00007f15f7340ad3 in ?? ()
67 LWP 14627 "rpc worker-1462" 0x00007f15f7340ad3 in ?? ()
68 LWP 14628 "rpc worker-1462" 0x00007f15f7340ad3 in ?? ()
69 LWP 14629 "rpc worker-1462" 0x00007f15f7340ad3 in ?? ()
70 LWP 14630 "rpc worker-1463" 0x00007f15f7340ad3 in ?? ()
71 LWP 14631 "rpc worker-1463" 0x00007f15f7340ad3 in ?? ()
72 LWP 14632 "rpc worker-1463" 0x00007f15f7340ad3 in ?? ()
73 LWP 14633 "rpc worker-1463" 0x00007f15f7340ad3 in ?? ()
74 LWP 14634 "rpc worker-1463" 0x00007f15f7340ad3 in ?? ()
75 LWP 14635 "rpc worker-1463" 0x00007f15f7340ad3 in ?? ()
76 LWP 14636 "rpc worker-1463" 0x00007f15f7340ad3 in ?? ()
77 LWP 14637 "rpc worker-1463" 0x00007f15f7340ad3 in ?? ()
78 LWP 14638 "rpc worker-1463" 0x00007f15f7340ad3 in ?? ()
79 LWP 14639 "rpc worker-1463" 0x00007f15f7340ad3 in ?? ()
80 LWP 14640 "rpc worker-1464" 0x00007f15f7340ad3 in ?? ()
81 LWP 14641 "rpc worker-1464" 0x00007f15f7340ad3 in ?? ()
82 LWP 14642 "rpc worker-1464" 0x00007f15f7340ad3 in ?? ()
83 LWP 14643 "rpc worker-1464" 0x00007f15f7340ad3 in ?? ()
84 LWP 14644 "rpc worker-1464" 0x00007f15f7340ad3 in ?? ()
85 LWP 14645 "rpc worker-1464" 0x00007f15f7340ad3 in ?? ()
86 LWP 14646 "rpc worker-1464" 0x00007f15f7340ad3 in ?? ()
87 LWP 14647 "rpc worker-1464" 0x00007f15f7340ad3 in ?? ()
88 LWP 14648 "rpc worker-1464" 0x00007f15f7340ad3 in ?? ()
89 LWP 14649 "rpc worker-1464" 0x00007f15f7340ad3 in ?? ()
90 LWP 14650 "rpc worker-1465" 0x00007f15f7340ad3 in ?? ()
91 LWP 14651 "rpc worker-1465" 0x00007f15f7340ad3 in ?? ()
92 LWP 14652 "rpc worker-1465" 0x00007f15f7340ad3 in ?? ()
93 LWP 14653 "rpc worker-1465" 0x00007f15f7340ad3 in ?? ()
94 LWP 14654 "rpc worker-1465" 0x00007f15f7340ad3 in ?? ()
95 LWP 14655 "rpc worker-1465" 0x00007f15f7340ad3 in ?? ()
96 LWP 14656 "rpc worker-1465" 0x00007f15f7340ad3 in ?? ()
97 LWP 14657 "rpc worker-1465" 0x00007f15f7340ad3 in ?? ()
98 LWP 14658 "rpc worker-1465" 0x00007f15f7340ad3 in ?? ()
99 LWP 14659 "rpc worker-1465" 0x00007f15f7340ad3 in ?? ()
100 LWP 14660 "rpc worker-1466" 0x00007f15f7340ad3 in ?? ()
101 LWP 14661 "rpc worker-1466" 0x00007f15f7340ad3 in ?? ()
102 LWP 14662 "rpc worker-1466" 0x00007f15f7340ad3 in ?? ()
103 LWP 14663 "rpc worker-1466" 0x00007f15f7340ad3 in ?? ()
104 LWP 14664 "rpc worker-1466" 0x00007f15f7340ad3 in ?? ()
105 LWP 14665 "rpc worker-1466" 0x00007f15f7340ad3 in ?? ()
106 LWP 14666 "rpc worker-1466" 0x00007f15f7340ad3 in ?? ()
107 LWP 14667 "rpc worker-1466" 0x00007f15f7340ad3 in ?? ()
108 LWP 14668 "rpc worker-1466" 0x00007f15f7340ad3 in ?? ()
109 LWP 14669 "rpc worker-1466" 0x00007f15f7340ad3 in ?? ()
110 LWP 14670 "rpc worker-1467" 0x00007f15f7340ad3 in ?? ()
111 LWP 14671 "rpc worker-1467" 0x00007f15f7340ad3 in ?? ()
112 LWP 14672 "rpc worker-1467" 0x00007f15f7340ad3 in ?? ()
113 LWP 14673 "rpc worker-1467" 0x00007f15f7340ad3 in ?? ()
114 LWP 14674 "rpc worker-1467" 0x00007f15f7340ad3 in ?? ()
115 LWP 14675 "rpc worker-1467" 0x00007f15f7340ad3 in ?? ()
116 LWP 14676 "rpc worker-1467" 0x00007f15f7340ad3 in ?? ()
117 LWP 14677 "diag-logger-146" 0x00007f15f7340fb9 in ?? ()
118 LWP 14678 "result-tracker-" 0x00007f15f7340fb9 in ?? ()
119 LWP 14679 "excess-log-dele" 0x00007f15f7340fb9 in ?? ()
120 LWP 14680 "acceptor-14680" 0x00007f15efe85fc7 in ?? ()
121 LWP 14681 "heartbeat-14681" 0x00007f15f7340fb9 in ?? ()
122 LWP 14684 "maintenance_sch" 0x00007f15f7340fb9 in ?? ()
Thread 122 (LWP 14684):
#0 0x00007f15f7340fb9 in ?? ()
#1 0x00007f15ac17d700 in ?? ()
#2 0x0000000000000032 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000616000016ca0 in ?? ()
#5 0x00007f15ac17d750 in ?? ()
#6 0x0000000000000064 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 14681):
#0 0x00007f15f7340fb9 in ?? ()
#1 0xee0390f6396bc70b in ?? ()
#2 0x000000000000000c in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061300001bfc0 in ?? ()
#5 0x00007f15ad1a4610 in ?? ()
#6 0x0000000000000018 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 120 (LWP 14680):
#0 0x00007f15efe85fc7 in ?? ()
#1 0x00006140000218a8 in ?? ()
#2 0x00007f15ad9cbd70 in ?? ()
#3 0x00007f15ad9cbda0 in ?? ()
#4 0x00007f15ad9cbea0 in ?? ()
#5 0x00007f15ad9cbd90 in ?? ()
#6 0x00007f15ad9cbe00 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000008d957b in __sanitizer::theDepot ()
#9 0x0000000500000014 in ?? ()
#10 0x00007f15ad9cbf20 in ?? ()
#11 0x00007f15ad9cb65c in ?? ()
#12 0x00000032ad9cb5d0 in ?? ()
#13 0x00007f15ad1cf000 in ?? ()
#14 0x0000000000000000 in ?? ()
Thread 119 (LWP 14679):
#0 0x00007f15f7340fb9 in ?? ()
#1 0x00007f15ae1e5f60 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 14678):
#0 0x00007f15f7340fb9 in ?? ()
#1 0x00007f15ae9fe120 in ?? ()
#2 0x000000000000000c in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100008caf0 in ?? ()
#5 0x00007f15ae9fe110 in ?? ()
#6 0x0000000000000018 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 14677):
#0 0x00007f15f7340fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 14676):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000008 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0002b0048 in ?? ()
#4 0x00007f15afa2deb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f15afa2ded0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 115 (LWP 14675):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 114 (LWP 14674):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 14673):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 14672):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 14671):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 14670):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 14669):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 14668):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 14667):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 14666):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 14665):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 14664):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 14663):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 14662):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 14661):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 14660):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 14659):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 14658):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 14657):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 14656):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 14655):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 14654):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 14653):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 14652):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 14651):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 14650):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 14649):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 14648):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 14647):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 14646):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 14645):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 14644):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 14643):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 14642):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 14641):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 14640):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 14639):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 14638):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 14637):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 14636):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a6888 in ?? ()
#4 0x00007f15c3dfeeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f15c3dfeed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 75 (LWP 14635):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 74 (LWP 14634):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 73 (LWP 14633):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 14632):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 14631):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 14630):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 14629):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 14628):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 14627):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 14626):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 14625):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 14624):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 14623):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 14622):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 14621):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 14620):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 14619):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 14618):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 14617):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 14616):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d000120038 in ?? ()
#4 0x00007f15cd7c7eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f15cd7c7ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 55 (LWP 14615):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 54 (LWP 14614):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 53 (LWP 14613):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 14612):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 14611):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 14610):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 14609):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 14608):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 14607):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 14606):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 14605):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 14604):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 14603):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 14602):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 14601):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 14600):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 14599):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 14598):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 14597):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 14596):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00009ffe8 in ?? ()
#4 0x00007f15d79a8eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f15d79a8ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 35 (LWP 14595):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 34 (LWP 14594):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 33 (LWP 14593):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 14592):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 14591):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 14590):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 14589):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 14588):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 14587):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 14586):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 14585):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 14584):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 14583):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 14582):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 14581):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 14580):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 14579):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 14578):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 14577):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 14576):
#0 0x00007f15f7340fb9 in ?? ()
#1 0x00007f15e1ac8ce0 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061300001c860 in ?? ()
#5 0x00007f15e1ac8cd0 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 14575):
#0 0x00007f15f7340fb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001fe98 in ?? ()
#5 0x00007f15e22ca270 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 14574):
#0 0x00007f15f7340fb9 in ?? ()
#1 0x00007f15e2aca260 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061800000c5a8 in ?? ()
#5 0x00007f15e2aca250 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 14573):
#0 0x00007f15f7340ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 14572):
#0 0x00007f15efe84947 in ?? ()
#1 0x00007f15e3acd340 in ?? ()
#2 0x000061a00000c680 in ?? ()
#3 0x00007f15e3acd330 in ?? ()
#4 0x00007f15e3acd540 in ?? ()
#5 0x00007f15e3acd380 in ?? ()
#6 0x0000614000021e98 in ?? ()
#7 0x00007f15e3acd400 in ?? ()
#8 0x00007f15f24f925d in ?? ()
#9 0x3fb957f2b4853000 in ?? ()
#10 0x000061a00000c680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c680 in ?? ()
#13 0x00000000fac8d3d0 in ?? ()
#14 0x00007f1500000000 in ?? ()
#15 0x41da7c9832a3fe13 in ?? ()
#16 0x00000fe33c751a80 in ?? ()
#17 0x00007f15e3acd3e0 in ?? ()
#18 0x00007f15f24fdba3 in ?? ()
#19 0x00007f15e3acd3b0 in ?? ()
#20 0x3fb957f2b4853000 in ?? ()
#21 0x00000000e3acd400 in ?? ()
#22 0x000061a00000c680 in ?? ()
#23 0x0000614000021e98 in ?? ()
#24 0x3fb957f2b4853000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 14571):
#0 0x00007f15efe84947 in ?? ()
#1 0x00007f15e42ce340 in ?? ()
#2 0x000061a00000c080 in ?? ()
#3 0x00007f15e42ce330 in ?? ()
#4 0x00007f15e42ce540 in ?? ()
#5 0x00007f15e42ce380 in ?? ()
#6 0x0000614000021c98 in ?? ()
#7 0x00007f15e42ce400 in ?? ()
#8 0x00007f15f24f925d in ?? ()
#9 0x3fb951fb5b951000 in ?? ()
#10 0x000061a00000c080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c080 in ?? ()
#13 0x00000000fac8d3d0 in ?? ()
#14 0x00007f1500000000 in ?? ()
#15 0x41da7c9832a3fe12 in ?? ()
#16 0x00000fe33c851c80 in ?? ()
#17 0x00007f15e42ce3e0 in ?? ()
#18 0x00007f15f24fdba3 in ?? ()
#19 0x00007f15e42ce3b0 in ?? ()
#20 0x3fb951fb5b951000 in ?? ()
#21 0x00000000e42ce400 in ?? ()
#22 0x000061a00000c080 in ?? ()
#23 0x0000614000021c98 in ?? ()
#24 0x3fb951fb5b951000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 14570):
#0 0x00007f15efe84947 in ?? ()
#1 0x00007f15e4acf340 in ?? ()
#2 0x000061a00000ba80 in ?? ()
#3 0x00007f15e4acf330 in ?? ()
#4 0x00007f15e4acf540 in ?? ()
#5 0x00007f15e4acf380 in ?? ()
#6 0x0000614000021a98 in ?? ()
#7 0x00007f15e4acf400 in ?? ()
#8 0x00007f15f24f925d in ?? ()
#9 0x3fb9502c4199a000 in ?? ()
#10 0x000061a00000ba80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ba80 in ?? ()
#13 0x00000000fac8d3d0 in ?? ()
#14 0x00007f1500000000 in ?? ()
#15 0x41da7c9832a3fe10 in ?? ()
#16 0x00000fe33c951e80 in ?? ()
#17 0x00007f15e4acf3e0 in ?? ()
#18 0x00007f15f24fdba3 in ?? ()
#19 0x00007f15e4acf3b0 in ?? ()
#20 0x3fb9502c4199a000 in ?? ()
#21 0x00000000e4acf400 in ?? ()
#22 0x000061a00000ba80 in ?? ()
#23 0x0000614000021a98 in ?? ()
#24 0x3fb9502c4199a000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 14569):
#0 0x00007f15efe84947 in ?? ()
#1 0x00007f15e66b3340 in ?? ()
#2 0x000061a00000b480 in ?? ()
#3 0x00007f15e66b3330 in ?? ()
#4 0x00007f15e66b3540 in ?? ()
#5 0x00007f15e66b3380 in ?? ()
#6 0x0000614000021898 in ?? ()
#7 0x00007f15e66b3400 in ?? ()
#8 0x00007f15f24f925d in ?? ()
#9 0x3fb96fedca5cf000 in ?? ()
#10 0x000061a00000b480 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000b480 in ?? ()
#13 0x00000000fac8d3d0 in ?? ()
#14 0x00007f1500000000 in ?? ()
#15 0x41da7c9832a3fe0f in ?? ()
#16 0x00000fe33ccce680 in ?? ()
#17 0x00007f15e66b33e0 in ?? ()
#18 0x00007f15f24fdba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 14566):
#0 0x00007f15efe77bb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007f15e86b77b8 in ?? ()
#3 0x000060200001ea50 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000008d11c1 in __sanitizer::theDepot ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 14565):
#0 0x00007f15f7340fb9 in ?? ()
#1 0x00007f15e7eb60e0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 14564):
#0 0x00007f15f73449e2 in ?? ()
#1 0x00007f15e6eb2bc0 in ?? ()
#2 0x00007f15e6eb2c60 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007f15e6eb2c10 in ?? ()
#6 0x00000000017d0860 in ?? ()
#7 0x00007f15e6eb2c70 in ?? ()
#8 0x000061100008d450 in ?? ()
#9 0x00007f15e6eb2c60 in ?? ()
#10 0x00000000008cb6b7 in __sanitizer::theDepot ()
#11 0x00007f15fccedbfc in ?? ()
#12 0x00007f15fccdd209 in ?? ()
#13 0x00007f15fcce17f6 in ?? ()
#14 0x00007f15fcce6230 in ?? ()
#15 0x00007f15fcce6059 in ?? ()
#16 0x0000000000aa4cad in __sanitizer::theDepot ()
#17 0x00007f15f3d6c529 in ?? ()
#18 0x00007f15f733a6db in ?? ()
#19 0x00000fe33cdce488 in ?? ()
#20 0x00007f15e6eb2460 in ?? ()
#21 0x0000000000000000 in ?? ()
Thread 5 (LWP 14558):
#0 0x00007f15f7340fb9 in ?? ()
#1 0x00007f15e96b8ca0 in ?? ()
#2 0x0000000000000044 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200000c728 in ?? ()
#5 0x00007f15e96b8c90 in ?? ()
#6 0x0000000000000088 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 14557):
#0 0x00007f15f7340fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 14556):
#0 0x00007f15f7340fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 14555):
#0 0x00007f15f7340fb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000612000012b38 in ?? ()
#5 0x00007f15eaebc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 14553):
#0 0x00007f15f7344d50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20260429 19:56:15.415639 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 14416
I20260429 19:56:15.426371 14540 generic_service.cc:196] Checking for leaks (request via RPC)
I20260429 19:56:15.686198 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 14416
I20260429 19:56:15.726374 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 14142
I20260429 19:56:15.733471 14266 generic_service.cc:196] Checking for leaks (request via RPC)
I20260429 19:56:15.982857 14885 raft_consensus.cc:493] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c716e625b12e48419e4855fc59197a15)
I20260429 19:56:15.983093 14885 raft_consensus.cc:515] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c716e625b12e48419e4855fc59197a15" member_type: VOTER last_known_addr { host: "127.10.32.66" port: 43535 } } peers { permanent_uuid: "5fd13bd23da4400b90382adbc6d22955" member_type: VOTER last_known_addr { host: "127.10.32.65" port: 38215 } } peers { permanent_uuid: "7c14d1f90d944ae4b2f546d620ec249c" member_type: VOTER last_known_addr { host: "127.10.32.67" port: 44017 } }
I20260429 19:56:15.984891 14885 leader_election.cc:290] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c716e625b12e48419e4855fc59197a15 (127.10.32.66:43535), 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215)
W20260429 19:56:15.987707 14297 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.32.65:38215: connect: Connection refused (error 111)
I20260429 19:56:16.000826 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 14142
W20260429 19:56:16.002003 14297 leader_election.cc:336] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5fd13bd23da4400b90382adbc6d22955 (127.10.32.65:38215): Network error: Client connection negotiation failed: client connection to 127.10.32.65:38215: connect: Connection refused (error 111)
I20260429 19:56:16.043099 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 14278
W20260429 19:56:16.044114 14887 negotiation.cc:336] Failed RPC negotiation. Trace:
0429 19:56:15.985175 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.10.32.66:43535 (local address 127.10.32.67:42701)
0429 19:56:15.986832 (+ 1657us) negotiation.cc:107] Waiting for socket to connect
0429 19:56:15.986862 (+ 30us) client_negotiation.cc:175] Beginning negotiation
0429 19:56:15.987062 (+ 200us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0429 19:56:16.000360 (+ 13298us) client_negotiation.cc:272] Received NEGOTIATE NegotiatePB response
0429 19:56:16.000365 (+ 5us) client_negotiation.cc:395] Received NEGOTIATE response from server
0429 19:56:16.000395 (+ 30us) client_negotiation.cc:190] Negotiated authn=CERTIFICATE
0429 19:56:16.001121 (+ 726us) client_negotiation.cc:515] Sending TLS_HANDSHAKE message to server
0429 19:56:16.001137 (+ 16us) client_negotiation.cc:253] Sending TLS_HANDSHAKE NegotiatePB request
0429 19:56:16.043020 (+ 41883us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.32.66:43535: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1517,"thread_start_us":1260,"threads_started":1}
W20260429 19:56:16.045318 14295 leader_election.cc:336] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c716e625b12e48419e4855fc59197a15 (127.10.32.66:43535): Network error: Client connection negotiation failed: client connection to 127.10.32.66:43535: connect: Connection refused (error 111)
I20260429 19:56:16.045451 14295 leader_election.cc:304] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c14d1f90d944ae4b2f546d620ec249c; no voters: 5fd13bd23da4400b90382adbc6d22955, c716e625b12e48419e4855fc59197a15
I20260429 19:56:16.045864 14885 raft_consensus.cc:2749] T b25d2531d0c044f7b297f7f323e75414 P 7c14d1f90d944ae4b2f546d620ec249c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260429 19:56:16.050177 14403 generic_service.cc:196] Checking for leaks (request via RPC)
I20260429 19:56:16.311604 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 14278
W20260429 19:56:16.355654 11615 connection.cc:570] server connection from 127.10.32.67:33815 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260429 19:56:16.355978 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 14553
I20260429 19:56:16.362996 14676 generic_service.cc:196] Checking for leaks (request via RPC)
I20260429 19:56:16.453141 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 14553
I20260429 19:56:16.469126 10369 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu pid 11597
I20260429 19:56:16.470232 11657 generic_service.cc:196] Checking for leaks (request via RPC)
I20260429 19:56:16.612908 10369 external_mini_cluster.cc:1658] Killing /tmp/dist-test-tasksFvwcp/build/asan/bin/kudu with pid 11597
2026-04-29T19:56:16Z chronyd exiting
I20260429 19:56:16.653601 10369 test_util.cc:182] -----------------------------------------------
I20260429 19:56:16.653738 10369 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-tasksFvwcp/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777492465722499-10369-0
[ FAILED ] RollingRestartArgs/RollingRestartITest.TestWorkloads/4, where GetParam() = 800-byte object <01-00 00-00 01-61 73-61 04-00 00-00 BE-BE BE-BE A0-24 00-00 80-61 00-00 00-00 00-00 00-00 00-00 00-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE C0-24 00-00 80-61 00-00 00-00 00-00 00-00 00-00 ... BE-BE BE-BE BE-BE BE-BE 78-27 00-00 80-61 00-00 00-00 00-00 00-00 00-00 00-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE 00-01 00-BE BE-BE BE-BE 04-00 00-00 03-00 00-00 01-BE BE-BE BE-BE BE-BE> (66875 ms)
[----------] 1 test from RollingRestartArgs/RollingRestartITest (66875 ms total)
[----------] Global test environment tear-down
[==========] 2 tests from 2 test suites ran. (110866 ms total)
[ PASSED ] 1 test.
[ FAILED ] 1 test, listed below:
[ FAILED ] RollingRestartArgs/RollingRestartITest.TestWorkloads/4, where GetParam() = 800-byte object <01-00 00-00 01-61 73-61 04-00 00-00 BE-BE BE-BE A0-24 00-00 80-61 00-00 00-00 00-00 00-00 00-00 00-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE C0-24 00-00 80-61 00-00 00-00 00-00 00-00 00-00 ... BE-BE BE-BE BE-BE BE-BE 78-27 00-00 80-61 00-00 00-00 00-00 00-00 00-00 00-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE 00-01 00-BE BE-BE BE-BE 04-00 00-00 03-00 00-00 01-BE BE-BE BE-BE BE-BE>
1 FAILED TEST
I20260429 19:56:16.655326 10369 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/client/meta_cache.cc:302: suppressed but not reported on 11 messages since previous log ~17 seconds ago