[==========] Running 14 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 12 tests from RaftConsensusElectionITest
[ RUN ] RaftConsensusElectionITest.TestNewLeaderCantResolvePeers
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260806 15:53:46.148312 10999 test_util.cc:268] Using random seed: -459122272
I20260806 15:53:46.160013 10999 ts_itest-base.cc:112] Starting cluster with:
I20260806 15:53:46.160123 10999 ts_itest-base.cc:113] --------------
I20260806 15:53:46.160144 10999 ts_itest-base.cc:114] 3 tablet servers
I20260806 15:53:46.160179 10999 ts_itest-base.cc:115] 3 replicas per TS
I20260806 15:53:46.160205 10999 ts_itest-base.cc:116] --------------
2026-08-06T15:53:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:53:46Z Disabled control of system clock
I20260806 15:53:46.173970 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:43287
--webserver_interface=127.10.189.254
--webserver_port=0
--builtin_ntp_servers=127.10.189.212:42047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.189.254:43287
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260806 15:53:46.297298 11013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:53:46.297580 11013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:53:46.297614 11013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:53:46.301734 11013 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:53:46.301787 11013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:53:46.301805 11013 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:53:46.301821 11013 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:53:46.306684 11013 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:42047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.10.189.254:43287
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:43287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/master-0/data/info.pb
--webserver_interface=127.10.189.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.11013
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:53:46.308079 11013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:53:46.310055 11013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:53:46.322710 11019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:53:46.323186 11018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:53:46.324098 11013 server_base.cc:1034] running on GCE node
W20260806 15:53:46.324180 11021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:53:46.324875 11013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:53:46.326601 11013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:53:46.327797 11013 hybrid_clock.cc:648] HybridClock initialized: now 1786031626327765 us; error 43 us; skew 500 ppm
I20260806 15:53:46.330013 11013 webserver.cc:460] Webserver started at http://127.10.189.254:35817/ using document root <none> and password file <none>
I20260806 15:53:46.330940 11013 fs_manager.cc:359] Metadata directory not provided
I20260806 15:53:46.331040 11013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:53:46.331435 11013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:53:46.333961 11013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/master-0/data/instance:
uuid: "0953f69755c54d5c856caf9bba75b613"
format_stamp: "Formatted at 2026-08-06 15:53:46 on dist-test-slave-mn4r"
I20260806 15:53:46.334787 11013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/master-0/wal/instance:
uuid: "0953f69755c54d5c856caf9bba75b613"
format_stamp: "Formatted at 2026-08-06 15:53:46 on dist-test-slave-mn4r"
I20260806 15:53:46.339761 11013 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 15:53:46.343192 11027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:53:46.344802 11013 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 15:53:46.345021 11013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/master-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/master-0/wal
uuid: "0953f69755c54d5c856caf9bba75b613"
format_stamp: "Formatted at 2026-08-06 15:53:46 on dist-test-slave-mn4r"
I20260806 15:53:46.345141 11013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:53:46.362764 11013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:53:46.363580 11013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:53:46.363818 11013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:53:46.375010 11013 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.254:43287
I20260806 15:53:46.375047 11085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.254:43287 every 8 connection(s)
I20260806 15:53:46.376385 11013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/master-0/data/info.pb
I20260806 15:53:46.380751 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 11013
I20260806 15:53:46.380959 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/master-0/wal/instance
I20260806 15:53:46.382506 11086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:53:46.392028 11086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613: Bootstrap starting.
I20260806 15:53:46.396315 11086 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613: Neither blocks nor log segments found. Creating new log.
I20260806 15:53:46.397282 11086 log.cc:824] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613: Log is configured to *not* fsync() on all Append() calls
I20260806 15:53:46.400576 11086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613: No bootstrap required, opened a new log
I20260806 15:53:46.405817 11086 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0953f69755c54d5c856caf9bba75b613" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 43287 } }
I20260806 15:53:46.406198 11086 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:53:46.406337 11086 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0953f69755c54d5c856caf9bba75b613, State: Initialized, Role: FOLLOWER
I20260806 15:53:46.407055 11086 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0953f69755c54d5c856caf9bba75b613" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 43287 } }
I20260806 15:53:46.407279 11086 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:53:46.407437 11086 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:53:46.407609 11086 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:53:46.408557 11086 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0953f69755c54d5c856caf9bba75b613" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 43287 } }
I20260806 15:53:46.409180 11086 leader_election.cc:302] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0953f69755c54d5c856caf9bba75b613; no voters:
I20260806 15:53:46.409642 11086 leader_election.cc:288] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:53:46.409883 11092 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:53:46.410207 11092 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613 [term 1 LEADER]: Becoming Leader. State: Replica: 0953f69755c54d5c856caf9bba75b613, State: Running, Role: LEADER
I20260806 15:53:46.410691 11092 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0953f69755c54d5c856caf9bba75b613" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 43287 } }
I20260806 15:53:46.411410 11086 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:53:46.413446 11095 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0953f69755c54d5c856caf9bba75b613. Latest consensus state: current_term: 1 leader_uuid: "0953f69755c54d5c856caf9bba75b613" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0953f69755c54d5c856caf9bba75b613" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 43287 } } }
I20260806 15:53:46.413614 11095 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613 [sys.catalog]: This master's current role is: LEADER
I20260806 15:53:46.414036 11093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0953f69755c54d5c856caf9bba75b613" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0953f69755c54d5c856caf9bba75b613" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 43287 } } }
I20260806 15:53:46.414184 11093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613 [sys.catalog]: This master's current role is: LEADER
I20260806 15:53:46.414938 11105 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:53:46.420771 11105 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:53:46.429296 11105 catalog_manager.cc:1347] Generated new cluster ID: 24129a7145e6403aa5924db41ec04e59
I20260806 15:53:46.429390 11105 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:53:46.442512 11105 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:53:46.443499 11105 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:53:46.452978 11105 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0953f69755c54d5c856caf9bba75b613: Generated new TSK 0
I20260806 15:53:46.453874 11105 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:53:46.466601 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.193:0
--local_ip_for_outbound_sockets=127.10.189.193
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:43287
--builtin_ntp_servers=127.10.189.212:42047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--dns_resolver_cache_capacity_mb=0
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=3
--leader_failure_max_missed_heartbeat_periods=10
--leader_failure_exp_backoff_max_delta_ms=5000 with env {}
W20260806 15:53:46.626602 11114 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:53:46.626896 11114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:53:46.626917 11114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:53:46.626987 11114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:53:46.631155 11114 flags.cc:425] Enabled experimental flag: --leader_failure_exp_backoff_max_delta_ms=5000
W20260806 15:53:46.631219 11114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:53:46.631274 11114 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.193
I20260806 15:53:46.636214 11114 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:42047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--leader_failure_exp_backoff_max_delta_ms=5000
--leader_failure_max_missed_heartbeat_periods=10
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:43287
--never_fsync=true
--heap_profile_path=/tmp/kudu.11114
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--dns_resolver_cache_capacity_mb=0
--local_ip_for_outbound_sockets=127.10.189.193
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:53:46.637375 11114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:53:46.638957 11114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:53:46.650774 11122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:53:46.650943 11119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:53:46.650801 11120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:53:46.651239 11114 server_base.cc:1034] running on GCE node
I20260806 15:53:46.651700 11114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:53:46.652475 11114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:53:46.653683 11114 hybrid_clock.cc:648] HybridClock initialized: now 1786031626653665 us; error 30 us; skew 500 ppm
I20260806 15:53:46.655750 11114 webserver.cc:460] Webserver started at http://127.10.189.193:37741/ using document root <none> and password file <none>
I20260806 15:53:46.656355 11114 fs_manager.cc:359] Metadata directory not provided
I20260806 15:53:46.656489 11114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:53:46.656745 11114 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:53:46.658804 11114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-0/data/instance:
uuid: "6fcb83828a3d46d7a621adcf2f5da935"
format_stamp: "Formatted at 2026-08-06 15:53:46 on dist-test-slave-mn4r"
I20260806 15:53:46.659405 11114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-0/wal/instance:
uuid: "6fcb83828a3d46d7a621adcf2f5da935"
format_stamp: "Formatted at 2026-08-06 15:53:46 on dist-test-slave-mn4r"
I20260806 15:53:46.663259 11114 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 15:53:46.665758 11128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:53:46.667186 11114 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 15:53:46.667317 11114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-0/wal
uuid: "6fcb83828a3d46d7a621adcf2f5da935"
format_stamp: "Formatted at 2026-08-06 15:53:46 on dist-test-slave-mn4r"
I20260806 15:53:46.667433 11114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:53:46.686163 11114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:53:46.686887 11114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:53:46.687086 11114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:53:46.687794 11114 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:53:46.688987 11114 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:53:46.689038 11114 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:53:46.689106 11114 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:53:46.689137 11114 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:53:46.705304 11114 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.193:45023
I20260806 15:53:46.705471 11253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.193:45023 every 8 connection(s)
I20260806 15:53:46.706416 11114 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-0/data/info.pb
I20260806 15:53:46.715622 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 11114
I20260806 15:53:46.715746 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-0/wal/instance
I20260806 15:53:46.718031 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.194:0
--local_ip_for_outbound_sockets=127.10.189.194
--webserver_interface=127.10.189.194
--webserver_port=0
--tserver_master_addrs=127.10.189.254:43287
--builtin_ntp_servers=127.10.189.212:42047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--dns_resolver_cache_capacity_mb=0
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=3
--leader_failure_max_missed_heartbeat_periods=10
--leader_failure_exp_backoff_max_delta_ms=5000 with env {}
I20260806 15:53:46.718029 11254 heartbeater.cc:347] Connected to a master server at 127.10.189.254:43287
I20260806 15:53:46.718325 11254 heartbeater.cc:464] Registering TS with master...
I20260806 15:53:46.718914 11254 heartbeater.cc:511] Master 127.10.189.254:43287 requested a full tablet report, sending...
I20260806 15:53:46.720861 11047 ts_manager.cc:194] Registered new tserver with Master: 6fcb83828a3d46d7a621adcf2f5da935 (127.10.189.193:45023)
I20260806 15:53:46.722441 11047 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.193:50493
W20260806 15:53:46.858353 11257 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:53:46.858614 11257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:53:46.858670 11257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:53:46.858723 11257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:53:46.862825 11257 flags.cc:425] Enabled experimental flag: --leader_failure_exp_backoff_max_delta_ms=5000
W20260806 15:53:46.862886 11257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:53:46.862982 11257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.194
I20260806 15:53:46.867800 11257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:42047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--leader_failure_exp_backoff_max_delta_ms=5000
--leader_failure_max_missed_heartbeat_periods=10
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.10.189.194
--webserver_port=0
--tserver_master_addrs=127.10.189.254:43287
--never_fsync=true
--heap_profile_path=/tmp/kudu.11257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--dns_resolver_cache_capacity_mb=0
--local_ip_for_outbound_sockets=127.10.189.194
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:53:46.868882 11257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:53:46.870687 11257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:53:46.881758 11263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:53:46.881809 11257 server_base.cc:1034] running on GCE node
W20260806 15:53:46.882005 11265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:53:46.881747 11262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:53:46.882530 11257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:53:46.883138 11257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:53:46.884301 11257 hybrid_clock.cc:648] HybridClock initialized: now 1786031626884279 us; error 33 us; skew 500 ppm
I20260806 15:53:46.886224 11257 webserver.cc:460] Webserver started at http://127.10.189.194:33369/ using document root <none> and password file <none>
I20260806 15:53:46.886777 11257 fs_manager.cc:359] Metadata directory not provided
I20260806 15:53:46.886838 11257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:53:46.887018 11257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:53:46.888916 11257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-1/data/instance:
uuid: "f4f80721de774d8c8245807d1160ed50"
format_stamp: "Formatted at 2026-08-06 15:53:46 on dist-test-slave-mn4r"
I20260806 15:53:46.889446 11257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-1/wal/instance:
uuid: "f4f80721de774d8c8245807d1160ed50"
format_stamp: "Formatted at 2026-08-06 15:53:46 on dist-test-slave-mn4r"
I20260806 15:53:46.893793 11257 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260806 15:53:46.896567 11272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:53:46.897864 11257 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 15:53:46.897976 11257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-1/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-1/wal
uuid: "f4f80721de774d8c8245807d1160ed50"
format_stamp: "Formatted at 2026-08-06 15:53:46 on dist-test-slave-mn4r"
I20260806 15:53:46.898063 11257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:53:46.943497 11257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:53:46.944348 11257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:53:46.944604 11257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:53:46.945330 11257 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:53:46.946537 11257 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:53:46.946592 11257 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:53:46.946638 11257 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:53:46.946663 11257 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:53:46.964094 11257 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.194:41859
I20260806 15:53:46.964167 11393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.194:41859 every 8 connection(s)
I20260806 15:53:46.965124 11257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-1/data/info.pb
I20260806 15:53:46.966095 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 11257
I20260806 15:53:46.966216 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-1/wal/instance
I20260806 15:53:46.968554 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.195:0
--local_ip_for_outbound_sockets=127.10.189.195
--webserver_interface=127.10.189.195
--webserver_port=0
--tserver_master_addrs=127.10.189.254:43287
--builtin_ntp_servers=127.10.189.212:42047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--dns_resolver_cache_capacity_mb=0
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=3
--leader_failure_max_missed_heartbeat_periods=10
--leader_failure_exp_backoff_max_delta_ms=5000 with env {}
I20260806 15:53:46.976667 11394 heartbeater.cc:347] Connected to a master server at 127.10.189.254:43287
I20260806 15:53:46.976953 11394 heartbeater.cc:464] Registering TS with master...
I20260806 15:53:46.977705 11394 heartbeater.cc:511] Master 127.10.189.254:43287 requested a full tablet report, sending...
I20260806 15:53:46.978929 11047 ts_manager.cc:194] Registered new tserver with Master: f4f80721de774d8c8245807d1160ed50 (127.10.189.194:41859)
I20260806 15:53:46.979516 11047 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.194:53229
W20260806 15:53:47.117231 11398 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:53:47.117580 11398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:53:47.117655 11398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:53:47.117738 11398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:53:47.122517 11398 flags.cc:425] Enabled experimental flag: --leader_failure_exp_backoff_max_delta_ms=5000
W20260806 15:53:47.122627 11398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:53:47.122728 11398 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.195
I20260806 15:53:47.127815 11398 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:42047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--leader_failure_exp_backoff_max_delta_ms=5000
--leader_failure_max_missed_heartbeat_periods=10
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.189.195
--webserver_port=0
--tserver_master_addrs=127.10.189.254:43287
--never_fsync=true
--heap_profile_path=/tmp/kudu.11398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--dns_resolver_cache_capacity_mb=0
--local_ip_for_outbound_sockets=127.10.189.195
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:53:47.129153 11398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:53:47.130779 11398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:53:47.142442 11405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:53:47.142699 11398 server_base.cc:1034] running on GCE node
W20260806 15:53:47.142889 11404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:53:47.142975 11407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:53:47.143541 11398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:53:47.144212 11398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:53:47.145407 11398 hybrid_clock.cc:648] HybridClock initialized: now 1786031627145373 us; error 49 us; skew 500 ppm
I20260806 15:53:47.147430 11398 webserver.cc:460] Webserver started at http://127.10.189.195:36241/ using document root <none> and password file <none>
I20260806 15:53:47.148052 11398 fs_manager.cc:359] Metadata directory not provided
I20260806 15:53:47.148147 11398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:53:47.148404 11398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:53:47.150427 11398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-2/data/instance:
uuid: "c20256155f744ef9afc2f3aa015f7cfe"
format_stamp: "Formatted at 2026-08-06 15:53:47 on dist-test-slave-mn4r"
I20260806 15:53:47.151134 11398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-2/wal/instance:
uuid: "c20256155f744ef9afc2f3aa015f7cfe"
format_stamp: "Formatted at 2026-08-06 15:53:47 on dist-test-slave-mn4r"
I20260806 15:53:47.155267 11398 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 15:53:47.157897 11415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:53:47.159216 11398 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 15:53:47.159363 11398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-2/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-2/wal
uuid: "c20256155f744ef9afc2f3aa015f7cfe"
format_stamp: "Formatted at 2026-08-06 15:53:47 on dist-test-slave-mn4r"
I20260806 15:53:47.159499 11398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:53:47.169737 11398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:53:47.170553 11398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:53:47.170769 11398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:53:47.171352 11398 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:53:47.172298 11398 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:53:47.172371 11398 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:53:47.172442 11398 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:53:47.172497 11398 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:53:47.187131 11398 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.195:36311
I20260806 15:53:47.187209 11536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.195:36311 every 8 connection(s)
I20260806 15:53:47.188179 11398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-2/data/info.pb
I20260806 15:53:47.197009 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 11398
I20260806 15:53:47.197125 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-2/wal/instance
I20260806 15:53:47.199287 11537 heartbeater.cc:347] Connected to a master server at 127.10.189.254:43287
I20260806 15:53:47.199542 11537 heartbeater.cc:464] Registering TS with master...
I20260806 15:53:47.200125 11537 heartbeater.cc:511] Master 127.10.189.254:43287 requested a full tablet report, sending...
I20260806 15:53:47.201100 11047 ts_manager.cc:194] Registered new tserver with Master: c20256155f744ef9afc2f3aa015f7cfe (127.10.189.195:36311)
I20260806 15:53:47.201670 11047 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.195:58225
I20260806 15:53:47.212042 10999 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:53:47.214452 10999 test_util.cc:268] Using random seed: -458056081
I20260806 15:53:47.232223 11047 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39670:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:53:47.233634 11047 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:53:47.253813 11182 tablet_service.cc:1467] Processing CreateTablet for tablet 35b7901e7c3444a4a4277549dd7ec2aa (DEFAULT_TABLE table=test-workload [id=e818c1a853ae4f2b8f886ea6f89a5cb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:53:47.253894 11470 tablet_service.cc:1467] Processing CreateTablet for tablet 35b7901e7c3444a4a4277549dd7ec2aa (DEFAULT_TABLE table=test-workload [id=e818c1a853ae4f2b8f886ea6f89a5cb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:53:47.255103 11182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35b7901e7c3444a4a4277549dd7ec2aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:53:47.255517 11324 tablet_service.cc:1467] Processing CreateTablet for tablet 35b7901e7c3444a4a4277549dd7ec2aa (DEFAULT_TABLE table=test-workload [id=e818c1a853ae4f2b8f886ea6f89a5cb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:53:47.256428 11470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35b7901e7c3444a4a4277549dd7ec2aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:53:47.256551 11324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35b7901e7c3444a4a4277549dd7ec2aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:53:47.263458 11554 tablet_bootstrap.cc:492] T 35b7901e7c3444a4a4277549dd7ec2aa P 6fcb83828a3d46d7a621adcf2f5da935: Bootstrap starting.
I20260806 15:53:47.264322 11556 tablet_bootstrap.cc:492] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe: Bootstrap starting.
I20260806 15:53:47.264803 11555 tablet_bootstrap.cc:492] T 35b7901e7c3444a4a4277549dd7ec2aa P f4f80721de774d8c8245807d1160ed50: Bootstrap starting.
I20260806 15:53:47.266299 11554 tablet_bootstrap.cc:654] T 35b7901e7c3444a4a4277549dd7ec2aa P 6fcb83828a3d46d7a621adcf2f5da935: Neither blocks nor log segments found. Creating new log.
I20260806 15:53:47.266621 11556 tablet_bootstrap.cc:654] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe: Neither blocks nor log segments found. Creating new log.
I20260806 15:53:47.267340 11554 log.cc:824] T 35b7901e7c3444a4a4277549dd7ec2aa P 6fcb83828a3d46d7a621adcf2f5da935: Log is configured to *not* fsync() on all Append() calls
I20260806 15:53:47.267488 11555 tablet_bootstrap.cc:654] T 35b7901e7c3444a4a4277549dd7ec2aa P f4f80721de774d8c8245807d1160ed50: Neither blocks nor log segments found. Creating new log.
I20260806 15:53:47.267720 11556 log.cc:824] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe: Log is configured to *not* fsync() on all Append() calls
I20260806 15:53:47.268827 11555 log.cc:824] T 35b7901e7c3444a4a4277549dd7ec2aa P f4f80721de774d8c8245807d1160ed50: Log is configured to *not* fsync() on all Append() calls
I20260806 15:53:47.269662 11554 tablet_bootstrap.cc:492] T 35b7901e7c3444a4a4277549dd7ec2aa P 6fcb83828a3d46d7a621adcf2f5da935: No bootstrap required, opened a new log
I20260806 15:53:47.269860 11554 ts_tablet_manager.cc:1397] T 35b7901e7c3444a4a4277549dd7ec2aa P 6fcb83828a3d46d7a621adcf2f5da935: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20260806 15:53:47.269903 11556 tablet_bootstrap.cc:492] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe: No bootstrap required, opened a new log
I20260806 15:53:47.270102 11556 ts_tablet_manager.cc:1397] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 15:53:47.271512 11555 tablet_bootstrap.cc:492] T 35b7901e7c3444a4a4277549dd7ec2aa P f4f80721de774d8c8245807d1160ed50: No bootstrap required, opened a new log
I20260806 15:53:47.271785 11555 ts_tablet_manager.cc:1397] T 35b7901e7c3444a4a4277549dd7ec2aa P f4f80721de774d8c8245807d1160ed50: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.005s
I20260806 15:53:47.274896 11554 raft_consensus.cc:348] T 35b7901e7c3444a4a4277549dd7ec2aa P 6fcb83828a3d46d7a621adcf2f5da935 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4f80721de774d8c8245807d1160ed50" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 41859 } } peers { permanent_uuid: "6fcb83828a3d46d7a621adcf2f5da935" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45023 } } peers { permanent_uuid: "c20256155f744ef9afc2f3aa015f7cfe" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36311 } }
I20260806 15:53:47.275136 11554 raft_consensus.cc:729] T 35b7901e7c3444a4a4277549dd7ec2aa P 6fcb83828a3d46d7a621adcf2f5da935 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fcb83828a3d46d7a621adcf2f5da935, State: Initialized, Role: FOLLOWER
I20260806 15:53:47.275425 11554 consensus_queue.cc:260] T 35b7901e7c3444a4a4277549dd7ec2aa P 6fcb83828a3d46d7a621adcf2f5da935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4f80721de774d8c8245807d1160ed50" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 41859 } } peers { permanent_uuid: "6fcb83828a3d46d7a621adcf2f5da935" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45023 } } peers { permanent_uuid: "c20256155f744ef9afc2f3aa015f7cfe" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36311 } }
I20260806 15:53:47.276127 11254 heartbeater.cc:503] Master 127.10.189.254:43287 was elected leader, sending a full tablet report...
I20260806 15:53:47.276522 11554 ts_tablet_manager.cc:1428] T 35b7901e7c3444a4a4277549dd7ec2aa P 6fcb83828a3d46d7a621adcf2f5da935: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260806 15:53:47.279160 11555 raft_consensus.cc:348] T 35b7901e7c3444a4a4277549dd7ec2aa P f4f80721de774d8c8245807d1160ed50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4f80721de774d8c8245807d1160ed50" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 41859 } } peers { permanent_uuid: "6fcb83828a3d46d7a621adcf2f5da935" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45023 } } peers { permanent_uuid: "c20256155f744ef9afc2f3aa015f7cfe" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36311 } }
I20260806 15:53:47.279435 11555 raft_consensus.cc:729] T 35b7901e7c3444a4a4277549dd7ec2aa P f4f80721de774d8c8245807d1160ed50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4f80721de774d8c8245807d1160ed50, State: Initialized, Role: FOLLOWER
I20260806 15:53:47.279752 11555 consensus_queue.cc:260] T 35b7901e7c3444a4a4277549dd7ec2aa P f4f80721de774d8c8245807d1160ed50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4f80721de774d8c8245807d1160ed50" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 41859 } } peers { permanent_uuid: "6fcb83828a3d46d7a621adcf2f5da935" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45023 } } peers { permanent_uuid: "c20256155f744ef9afc2f3aa015f7cfe" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36311 } }
I20260806 15:53:47.279894 11556 raft_consensus.cc:348] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4f80721de774d8c8245807d1160ed50" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 41859 } } peers { permanent_uuid: "6fcb83828a3d46d7a621adcf2f5da935" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45023 } } peers { permanent_uuid: "c20256155f744ef9afc2f3aa015f7cfe" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36311 } }
I20260806 15:53:47.280179 11556 raft_consensus.cc:729] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20256155f744ef9afc2f3aa015f7cfe, State: Initialized, Role: FOLLOWER
I20260806 15:53:47.280484 11556 consensus_queue.cc:260] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4f80721de774d8c8245807d1160ed50" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 41859 } } peers { permanent_uuid: "6fcb83828a3d46d7a621adcf2f5da935" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45023 } } peers { permanent_uuid: "c20256155f744ef9afc2f3aa015f7cfe" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36311 } }
I20260806 15:53:47.280859 11555 ts_tablet_manager.cc:1428] T 35b7901e7c3444a4a4277549dd7ec2aa P f4f80721de774d8c8245807d1160ed50: Time spent starting tablet: real 0.009s user 0.005s sys 0.003s
I20260806 15:53:47.281301 11537 heartbeater.cc:503] Master 127.10.189.254:43287 was elected leader, sending a full tablet report...
I20260806 15:53:47.281387 11556 ts_tablet_manager.cc:1428] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260806 15:53:47.281586 11394 heartbeater.cc:503] Master 127.10.189.254:43287 was elected leader, sending a full tablet report...
W20260806 15:53:47.307940 11388 generic_service.cc:139] {username='slave'} at 127.0.0.1:59754 forcing change of non-runtime-safe flag fail_dns_resolution_hostports
I20260806 15:53:47.308060 11388 generic_service.cc:175] {username='slave'} at 127.0.0.1:59754 changed flags via RPC: fail_dns_resolution_hostports from '' to '127.10.189.194:41859'
W20260806 15:53:47.309095 11388 generic_service.cc:139] {username='slave'} at 127.0.0.1:59754 forcing change of non-runtime-safe flag fail_dns_resolution
I20260806 15:53:47.309158 11388 generic_service.cc:175] {username='slave'} at 127.0.0.1:59754 changed flags via RPC: fail_dns_resolution from 'false' to 'true'
W20260806 15:53:47.313762 11531 generic_service.cc:139] {username='slave'} at 127.0.0.1:47304 forcing change of non-runtime-safe flag fail_dns_resolution_hostports
I20260806 15:53:47.313864 11531 generic_service.cc:175] {username='slave'} at 127.0.0.1:47304 changed flags via RPC: fail_dns_resolution_hostports from '' to '127.10.189.194:41859'
W20260806 15:53:47.314632 11531 generic_service.cc:139] {username='slave'} at 127.0.0.1:47304 forcing change of non-runtime-safe flag fail_dns_resolution
I20260806 15:53:47.314692 11531 generic_service.cc:175] {username='slave'} at 127.0.0.1:47304 changed flags via RPC: fail_dns_resolution from 'false' to 'true'
W20260806 15:53:47.319320 11247 generic_service.cc:139] {username='slave'} at 127.0.0.1:52006 forcing change of non-runtime-safe flag fail_dns_resolution_hostports
I20260806 15:53:47.319420 11247 generic_service.cc:175] {username='slave'} at 127.0.0.1:52006 changed flags via RPC: fail_dns_resolution_hostports from '' to '127.10.189.194:41859'
W20260806 15:53:47.320235 11247 generic_service.cc:139] {username='slave'} at 127.0.0.1:52006 forcing change of non-runtime-safe flag fail_dns_resolution
I20260806 15:53:47.320302 11247 generic_service.cc:175] {username='slave'} at 127.0.0.1:52006 changed flags via RPC: fail_dns_resolution from 'false' to 'true'
I20260806 15:53:47.321435 11491 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "35b7901e7c3444a4a4277549dd7ec2aa"
dest_uuid: "c20256155f744ef9afc2f3aa015f7cfe"
from {username='slave'} at 127.0.0.1:47294
I20260806 15:53:47.321765 11491 raft_consensus.cc:482] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:53:47.321933 11491 raft_consensus.cc:3037] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:53:47.323342 11491 raft_consensus.cc:504] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4f80721de774d8c8245807d1160ed50" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 41859 } } peers { permanent_uuid: "6fcb83828a3d46d7a621adcf2f5da935" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45023 } } peers { permanent_uuid: "c20256155f744ef9afc2f3aa015f7cfe" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36311 } }
I20260806 15:53:47.324551 11491 leader_election.cc:288] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [CANDIDATE]: Term 1 election: Requested vote from peers f4f80721de774d8c8245807d1160ed50 (127.10.189.194:41859), 6fcb83828a3d46d7a621adcf2f5da935 (127.10.189.193:45023)
W20260806 15:53:47.324837 11566 leader_election.cc:334] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [CANDIDATE]: Term 1 election: RPC error from VoteRequest() call to peer f4f80721de774d8c8245807d1160ed50 (127.10.189.194:41859): Network error: failed to refresh physical address: injected DNS resolution failure: 127.10.189.194:41859
I20260806 15:53:47.328960 11205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35b7901e7c3444a4a4277549dd7ec2aa" candidate_uuid: "c20256155f744ef9afc2f3aa015f7cfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6fcb83828a3d46d7a621adcf2f5da935"
I20260806 15:53:47.329367 11205 raft_consensus.cc:3037] T 35b7901e7c3444a4a4277549dd7ec2aa P 6fcb83828a3d46d7a621adcf2f5da935 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:53:47.330957 11205 raft_consensus.cc:2454] T 35b7901e7c3444a4a4277549dd7ec2aa P 6fcb83828a3d46d7a621adcf2f5da935 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20256155f744ef9afc2f3aa015f7cfe in term 1.
I20260806 15:53:47.331444 11418 leader_election.cc:302] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fcb83828a3d46d7a621adcf2f5da935, c20256155f744ef9afc2f3aa015f7cfe; no voters: f4f80721de774d8c8245807d1160ed50
I20260806 15:53:47.331815 11562 raft_consensus.cc:2781] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:53:47.332142 11562 raft_consensus.cc:686] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [term 1 LEADER]: Becoming Leader. State: Replica: c20256155f744ef9afc2f3aa015f7cfe, State: Running, Role: LEADER
I20260806 15:53:47.332512 11562 consensus_queue.cc:237] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4f80721de774d8c8245807d1160ed50" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 41859 } } peers { permanent_uuid: "6fcb83828a3d46d7a621adcf2f5da935" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45023 } } peers { permanent_uuid: "c20256155f744ef9afc2f3aa015f7cfe" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36311 } }
I20260806 15:53:47.336282 11045 catalog_manager.cc:5495] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe reported cstate change: term changed from 0 to 1, leader changed from <none> to c20256155f744ef9afc2f3aa015f7cfe (127.10.189.195). New cstate: current_term: 1 leader_uuid: "c20256155f744ef9afc2f3aa015f7cfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4f80721de774d8c8245807d1160ed50" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 41859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fcb83828a3d46d7a621adcf2f5da935" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20256155f744ef9afc2f3aa015f7cfe" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36311 } health_report { overall_health: HEALTHY } } }
I20260806 15:53:47.436894 11562 consensus_queue.cc:1035] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fcb83828a3d46d7a621adcf2f5da935" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 15:53:47.439373 11538 tablet.cc:2369] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 15:53:47.442566 11566 consensus_peers.cc:487] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe -> Peer f4f80721de774d8c8245807d1160ed50 (127.10.189.194:41859): Couldn't send request to peer f4f80721de774d8c8245807d1160ed50. Status: Network error: failed to refresh physical address: injected DNS resolution failure: 127.10.189.194:41859. This is attempt 1: this message will repeat every 5th retry.
W20260806 15:53:47.466426 11395 tablet.cc:2369] T 35b7901e7c3444a4a4277549dd7ec2aa P f4f80721de774d8c8245807d1160ed50: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 15:53:47.975728 11566 consensus_peers.cc:487] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe -> Peer f4f80721de774d8c8245807d1160ed50 (127.10.189.194:41859): Couldn't send request to peer f4f80721de774d8c8245807d1160ed50. Status: Network error: failed to refresh physical address: injected DNS resolution failure: 127.10.189.194:41859. This is attempt 6: this message will repeat every 5th retry.
W20260806 15:53:48.542937 11566 consensus_peers.cc:487] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe -> Peer f4f80721de774d8c8245807d1160ed50 (127.10.189.194:41859): Couldn't send request to peer f4f80721de774d8c8245807d1160ed50. Status: Network error: failed to refresh physical address: injected DNS resolution failure: 127.10.189.194:41859. This is attempt 11: this message will repeat every 5th retry.
W20260806 15:53:49.037766 11566 consensus_peers.cc:487] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe -> Peer f4f80721de774d8c8245807d1160ed50 (127.10.189.194:41859): Couldn't send request to peer f4f80721de774d8c8245807d1160ed50. Status: Network error: failed to refresh physical address: injected DNS resolution failure: 127.10.189.194:41859. This is attempt 16: this message will repeat every 5th retry.
W20260806 15:53:49.511989 11566 consensus_peers.cc:487] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe -> Peer f4f80721de774d8c8245807d1160ed50 (127.10.189.194:41859): Couldn't send request to peer f4f80721de774d8c8245807d1160ed50. Status: Network error: failed to refresh physical address: injected DNS resolution failure: 127.10.189.194:41859. This is attempt 21: this message will repeat every 5th retry.
W20260806 15:53:50.040038 11566 consensus_peers.cc:487] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe -> Peer f4f80721de774d8c8245807d1160ed50 (127.10.189.194:41859): Couldn't send request to peer f4f80721de774d8c8245807d1160ed50. Status: Network error: failed to refresh physical address: injected DNS resolution failure: 127.10.189.194:41859. This is attempt 26: this message will repeat every 5th retry.
I20260806 15:53:50.402518 11568 consensus_queue.cc:579] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [LEADER]: Leader has been unable to successfully communicate with peer f4f80721de774d8c8245807d1160ed50 for more than 3 seconds (3.069s)
W20260806 15:53:50.407266 11045 catalog_manager.cc:5173] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 35b7901e7c3444a4a4277549dd7ec2aa with cas_config_opid_index -1: no extra replica candidate found for tablet 35b7901e7c3444a4a4277549dd7ec2aa (table test-workload [id=e818c1a853ae4f2b8f886ea6f89a5cb3]): Not found: could not select location for extra replica: not enough tablet servers to satisfy replica placement policy: the total number of registered tablet servers (3) does not allow for adding an extra replica; consider bringing up more to have at least 4 tablet servers up and running
W20260806 15:53:50.408563 11388 generic_service.cc:139] {username='slave'} at 127.0.0.1:59754 forcing change of non-runtime-safe flag fail_dns_resolution
I20260806 15:53:50.408702 11388 generic_service.cc:175] {username='slave'} at 127.0.0.1:59754 changed flags via RPC: fail_dns_resolution from 'true' to 'false'
W20260806 15:53:50.410051 11531 generic_service.cc:139] {username='slave'} at 127.0.0.1:47304 forcing change of non-runtime-safe flag fail_dns_resolution
I20260806 15:53:50.410233 11531 generic_service.cc:175] {username='slave'} at 127.0.0.1:47304 changed flags via RPC: fail_dns_resolution from 'true' to 'false'
W20260806 15:53:50.411851 11247 generic_service.cc:139] {username='slave'} at 127.0.0.1:52006 forcing change of non-runtime-safe flag fail_dns_resolution
I20260806 15:53:50.412012 11247 generic_service.cc:175] {username='slave'} at 127.0.0.1:52006 changed flags via RPC: fail_dns_resolution from 'true' to 'false'
I20260806 15:53:50.515321 11346 raft_consensus.cc:3037] T 35b7901e7c3444a4a4277549dd7ec2aa P f4f80721de774d8c8245807d1160ed50 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:53:50.719501 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.196:0
--local_ip_for_outbound_sockets=127.10.189.196
--webserver_interface=127.10.189.196
--webserver_port=0
--tserver_master_addrs=127.10.189.254:43287
--builtin_ntp_servers=127.10.189.212:42047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--dns_resolver_cache_capacity_mb=0
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=3
--leader_failure_max_missed_heartbeat_periods=10
--leader_failure_exp_backoff_max_delta_ms=5000 with env {}
W20260806 15:53:50.963528 11580 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:53:50.963856 11580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:53:50.963919 11580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:53:50.963986 11580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:53:50.968248 11580 flags.cc:425] Enabled experimental flag: --leader_failure_exp_backoff_max_delta_ms=5000
W20260806 15:53:50.968355 11580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:53:50.968456 11580 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.196
I20260806 15:53:50.974310 11580 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:42047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--leader_failure_exp_backoff_max_delta_ms=5000
--leader_failure_max_missed_heartbeat_periods=10
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.196:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.10.189.196
--webserver_port=0
--tserver_master_addrs=127.10.189.254:43287
--never_fsync=true
--heap_profile_path=/tmp/kudu.11580
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--dns_resolver_cache_capacity_mb=0
--local_ip_for_outbound_sockets=127.10.189.196
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:53:50.975765 11580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:53:50.977576 11580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:53:50.988734 11588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:53:50.988811 11586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:53:50.988839 11585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:53:50.989246 11580 server_base.cc:1034] running on GCE node
I20260806 15:53:50.989603 11580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:53:50.990314 11580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:53:50.991480 11580 hybrid_clock.cc:648] HybridClock initialized: now 1786031630991463 us; error 26 us; skew 500 ppm
I20260806 15:53:50.997399 11580 webserver.cc:460] Webserver started at http://127.10.189.196:41857/ using document root <none> and password file <none>
I20260806 15:53:50.998037 11580 fs_manager.cc:359] Metadata directory not provided
I20260806 15:53:50.998189 11580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:53:50.998447 11580 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:53:51.000674 11580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-3/data/instance:
uuid: "29b274892e6f4a5591a391e0d937c74b"
format_stamp: "Formatted at 2026-08-06 15:53:50 on dist-test-slave-mn4r"
I20260806 15:53:51.001333 11580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-3/wal/instance:
uuid: "29b274892e6f4a5591a391e0d937c74b"
format_stamp: "Formatted at 2026-08-06 15:53:50 on dist-test-slave-mn4r"
I20260806 15:53:51.005261 11580 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260806 15:53:51.007958 11595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:53:51.009269 11580 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 15:53:51.009392 11580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-3/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-3/wal
uuid: "29b274892e6f4a5591a391e0d937c74b"
format_stamp: "Formatted at 2026-08-06 15:53:50 on dist-test-slave-mn4r"
I20260806 15:53:51.009496 11580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:53:51.032047 11580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:53:51.033051 11580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:53:51.033336 11580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:53:51.034070 11580 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:53:51.035112 11580 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:53:51.035185 11580 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:53:51.035255 11580 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:53:51.035302 11580 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:53:51.053355 11580 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.196:45653
I20260806 15:53:51.053375 11714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.196:45653 every 8 connection(s)
I20260806 15:53:51.054399 11580 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-3/data/info.pb
I20260806 15:53:51.062404 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 11580
I20260806 15:53:51.062532 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0/raft_consensus_election-itest-cluster/ts-3/wal/instance
I20260806 15:53:51.066012 11715 heartbeater.cc:347] Connected to a master server at 127.10.189.254:43287
I20260806 15:53:51.066293 11715 heartbeater.cc:464] Registering TS with master...
I20260806 15:53:51.066826 11715 heartbeater.cc:511] Master 127.10.189.254:43287 requested a full tablet report, sending...
I20260806 15:53:51.067813 11045 ts_manager.cc:194] Registered new tserver with Master: 29b274892e6f4a5591a391e0d937c74b (127.10.189.196:45653)
I20260806 15:53:51.068392 11045 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.196:47231
I20260806 15:53:51.074326 11491 consensus_queue.cc:237] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f4f80721de774d8c8245807d1160ed50" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 41859 } } peers { permanent_uuid: "6fcb83828a3d46d7a621adcf2f5da935" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45023 } } peers { permanent_uuid: "c20256155f744ef9afc2f3aa015f7cfe" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36311 } } peers { permanent_uuid: "29b274892e6f4a5591a391e0d937c74b" member_type: NON_VOTER last_known_addr { host: "127.10.189.196" port: 45653 } attrs { promote: true } }
I20260806 15:53:51.076146 11205 raft_consensus.cc:1261] T 35b7901e7c3444a4a4277549dd7ec2aa P 6fcb83828a3d46d7a621adcf2f5da935 [term 1 FOLLOWER]: Refusing update from remote peer c20256155f744ef9afc2f3aa015f7cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:53:51.076249 11346 raft_consensus.cc:1261] T 35b7901e7c3444a4a4277549dd7ec2aa P f4f80721de774d8c8245807d1160ed50 [term 1 FOLLOWER]: Refusing update from remote peer c20256155f744ef9afc2f3aa015f7cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:53:51.076644 11568 consensus_queue.cc:1035] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fcb83828a3d46d7a621adcf2f5da935" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260806 15:53:51.076828 11574 consensus_queue.cc:1035] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4f80721de774d8c8245807d1160ed50" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260806 15:53:51.079089 11574 raft_consensus.cc:2932] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 29b274892e6f4a5591a391e0d937c74b (127.10.189.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f4f80721de774d8c8245807d1160ed50" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 41859 } } peers { permanent_uuid: "6fcb83828a3d46d7a621adcf2f5da935" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45023 } } peers { permanent_uuid: "c20256155f744ef9afc2f3aa015f7cfe" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36311 } } peers { permanent_uuid: "29b274892e6f4a5591a391e0d937c74b" member_type: NON_VOTER last_known_addr { host: "127.10.189.196" port: 45653 } attrs { promote: true } } }
I20260806 15:53:51.079706 11346 raft_consensus.cc:2932] T 35b7901e7c3444a4a4277549dd7ec2aa P f4f80721de774d8c8245807d1160ed50 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 29b274892e6f4a5591a391e0d937c74b (127.10.189.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f4f80721de774d8c8245807d1160ed50" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 41859 } } peers { permanent_uuid: "6fcb83828a3d46d7a621adcf2f5da935" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45023 } } peers { permanent_uuid: "c20256155f744ef9afc2f3aa015f7cfe" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36311 } } peers { permanent_uuid: "29b274892e6f4a5591a391e0d937c74b" member_type: NON_VOTER last_known_addr { host: "127.10.189.196" port: 45653 } attrs { promote: true } } }
I20260806 15:53:51.079972 11205 raft_consensus.cc:2932] T 35b7901e7c3444a4a4277549dd7ec2aa P 6fcb83828a3d46d7a621adcf2f5da935 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 29b274892e6f4a5591a391e0d937c74b (127.10.189.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f4f80721de774d8c8245807d1160ed50" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 41859 } } peers { permanent_uuid: "6fcb83828a3d46d7a621adcf2f5da935" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45023 } } peers { permanent_uuid: "c20256155f744ef9afc2f3aa015f7cfe" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36311 } } peers { permanent_uuid: "29b274892e6f4a5591a391e0d937c74b" member_type: NON_VOTER last_known_addr { host: "127.10.189.196" port: 45653 } attrs { promote: true } } }
I20260806 15:53:51.081470 11031 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 35b7901e7c3444a4a4277549dd7ec2aa with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 6)
I20260806 15:53:51.082435 11045 catalog_manager.cc:5495] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe reported cstate change: config changed from index -1 to 2, NON_VOTER 29b274892e6f4a5591a391e0d937c74b (127.10.189.196) added. New cstate: current_term: 1 leader_uuid: "c20256155f744ef9afc2f3aa015f7cfe" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f4f80721de774d8c8245807d1160ed50" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fcb83828a3d46d7a621adcf2f5da935" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20256155f744ef9afc2f3aa015f7cfe" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29b274892e6f4a5591a391e0d937c74b" member_type: NON_VOTER last_known_addr { host: "127.10.189.196" port: 45653 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260806 15:53:51.085326 11416 consensus_peers.cc:487] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe -> Peer 29b274892e6f4a5591a391e0d937c74b (127.10.189.196:45653): Couldn't send request to peer 29b274892e6f4a5591a391e0d937c74b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35b7901e7c3444a4a4277549dd7ec2aa. This is attempt 1: this message will repeat every 5th retry.
I20260806 15:53:51.086027 11491 consensus_queue.cc:237] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f4f80721de774d8c8245807d1160ed50" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 41859 } } peers { permanent_uuid: "6fcb83828a3d46d7a621adcf2f5da935" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45023 } } peers { permanent_uuid: "c20256155f744ef9afc2f3aa015f7cfe" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36311 } }
I20260806 15:53:51.087492 11205 raft_consensus.cc:1261] T 35b7901e7c3444a4a4277549dd7ec2aa P 6fcb83828a3d46d7a621adcf2f5da935 [term 1 FOLLOWER]: Refusing update from remote peer c20256155f744ef9afc2f3aa015f7cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260806 15:53:51.087507 11346 raft_consensus.cc:1261] T 35b7901e7c3444a4a4277549dd7ec2aa P f4f80721de774d8c8245807d1160ed50 [term 1 FOLLOWER]: Refusing update from remote peer c20256155f744ef9afc2f3aa015f7cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260806 15:53:51.087888 11574 consensus_queue.cc:1035] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4f80721de774d8c8245807d1160ed50" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 41859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260806 15:53:51.088027 11568 consensus_queue.cc:1035] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fcb83828a3d46d7a621adcf2f5da935" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260806 15:53:51.089462 11568 raft_consensus.cc:2932] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER 29b274892e6f4a5591a391e0d937c74b (127.10.189.196) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f4f80721de774d8c8245807d1160ed50" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 41859 } } peers { permanent_uuid: "6fcb83828a3d46d7a621adcf2f5da935" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45023 } } peers { permanent_uuid: "c20256155f744ef9afc2f3aa015f7cfe" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36311 } } }
I20260806 15:53:51.089881 11346 raft_consensus.cc:2932] T 35b7901e7c3444a4a4277549dd7ec2aa P f4f80721de774d8c8245807d1160ed50 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER 29b274892e6f4a5591a391e0d937c74b (127.10.189.196) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f4f80721de774d8c8245807d1160ed50" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 41859 } } peers { permanent_uuid: "6fcb83828a3d46d7a621adcf2f5da935" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45023 } } peers { permanent_uuid: "c20256155f744ef9afc2f3aa015f7cfe" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36311 } } }
I20260806 15:53:51.090159 11205 raft_consensus.cc:2932] T 35b7901e7c3444a4a4277549dd7ec2aa P 6fcb83828a3d46d7a621adcf2f5da935 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER 29b274892e6f4a5591a391e0d937c74b (127.10.189.196) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f4f80721de774d8c8245807d1160ed50" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 41859 } } peers { permanent_uuid: "6fcb83828a3d46d7a621adcf2f5da935" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45023 } } peers { permanent_uuid: "c20256155f744ef9afc2f3aa015f7cfe" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36311 } } }
I20260806 15:53:51.091274 11031 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 35b7901e7c3444a4a4277549dd7ec2aa with cas_config_opid_index 2: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260806 15:53:51.092201 11046 catalog_manager.cc:5495] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe reported cstate change: config changed from index 2 to 3, NON_VOTER 29b274892e6f4a5591a391e0d937c74b (127.10.189.196) evicted. New cstate: current_term: 1 leader_uuid: "c20256155f744ef9afc2f3aa015f7cfe" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f4f80721de774d8c8245807d1160ed50" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fcb83828a3d46d7a621adcf2f5da935" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20256155f744ef9afc2f3aa015f7cfe" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36311 } health_report { overall_health: HEALTHY } } }
I20260806 15:53:51.099670 11646 tablet_service.cc:1514] Processing DeleteTablet for tablet 35b7901e7c3444a4a4277549dd7ec2aa with delete_type TABLET_DATA_TOMBSTONED (TS 29b274892e6f4a5591a391e0d937c74b not found in new config with opid_index 3) from {username='slave'} at 127.0.0.1:52610
W20260806 15:53:51.101182 11028 catalog_manager.cc:4808] TS 29b274892e6f4a5591a391e0d937c74b (127.10.189.196:45653): delete failed for tablet 35b7901e7c3444a4a4277549dd7ec2aa because the tablet was not found. No further retry: Not found: Tablet not found: 35b7901e7c3444a4a4277549dd7ec2aa
W20260806 15:53:51.116096 11388 generic_service.cc:139] {username='slave'} at 127.0.0.1:59754 forcing change of non-runtime-safe flag fail_dns_resolution
I20260806 15:53:51.116220 11388 generic_service.cc:175] {username='slave'} at 127.0.0.1:59754 changed flags via RPC: fail_dns_resolution from 'false' to 'true'
W20260806 15:53:51.117367 11531 generic_service.cc:139] {username='slave'} at 127.0.0.1:47304 forcing change of non-runtime-safe flag fail_dns_resolution
I20260806 15:53:51.117483 11531 generic_service.cc:175] {username='slave'} at 127.0.0.1:47304 changed flags via RPC: fail_dns_resolution from 'false' to 'true'
W20260806 15:53:51.118494 11247 generic_service.cc:139] {username='slave'} at 127.0.0.1:52006 forcing change of non-runtime-safe flag fail_dns_resolution
I20260806 15:53:51.118595 11247 generic_service.cc:175] {username='slave'} at 127.0.0.1:52006 changed flags via RPC: fail_dns_resolution from 'false' to 'true'
I20260806 15:53:51.119554 11491 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "35b7901e7c3444a4a4277549dd7ec2aa"
dest_uuid: "c20256155f744ef9afc2f3aa015f7cfe"
mode: GRACEFUL
new_leader_uuid: "c20256155f744ef9afc2f3aa015f7cfe"
from {username='slave'} at 127.0.0.1:47294
I20260806 15:53:51.119727 11491 raft_consensus.cc:595] T 35b7901e7c3444a4a4277549dd7ec2aa P c20256155f744ef9afc2f3aa015f7cfe [term 1 LEADER]: Received request to transfer leadership to TS c20256155f744ef9afc2f3aa015f7cfe
I20260806 15:53:52.070302 11715 heartbeater.cc:503] Master 127.10.189.254:43287 was elected leader, sending a full tablet report...
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/raft_consensus_election-itest.cc:292: Failure
Value of: tablets.empty()
Actual: true
Expected: false
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_util.cc:395: Failure
Failed
Timed out waiting for assertion to pass.
I20260806 15:54:21.201292 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 11114
I20260806 15:54:21.209306 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 11257
I20260806 15:54:21.216075 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 11398
I20260806 15:54:21.222805 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 11580
I20260806 15:54:21.228884 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 11013
2026-08-06T15:54:21Z chronyd exiting
I20260806 15:54:21.247874 10999 test_util.cc:175] -----------------------------------------------
I20260806 15:54:21.247927 10999 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786031626089658-10999-0
[ FAILED ] RaftConsensusElectionITest.TestNewLeaderCantResolvePeers (35105 ms)
[ RUN ] RaftConsensusElectionITest.RunLeaderElection
I20260806 15:54:21.248883 10999 test_util.cc:268] Using random seed: -424021649
I20260806 15:54:21.249754 10999 ts_itest-base.cc:112] Starting cluster with:
I20260806 15:54:21.249809 10999 ts_itest-base.cc:113] --------------
I20260806 15:54:21.249830 10999 ts_itest-base.cc:114] 3 tablet servers
I20260806 15:54:21.249858 10999 ts_itest-base.cc:115] 3 replicas per TS
I20260806 15:54:21.249883 10999 ts_itest-base.cc:116] --------------
2026-08-06T15:54:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:54:21Z Disabled control of system clock
I20260806 15:54:21.260394 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:39905
--webserver_interface=127.10.189.254
--webserver_port=0
--builtin_ntp_servers=127.10.189.212:41649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.189.254:39905 with env {}
W20260806 15:54:21.379005 11742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:54:21.379289 11742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:54:21.379357 11742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:54:21.383378 11742 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:54:21.383455 11742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:54:21.383498 11742 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:54:21.383560 11742 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:54:21.388240 11742 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:41649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.189.254:39905
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:39905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.10.189.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.11742
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:54:21.389317 11742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:54:21.390801 11742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:54:21.399727 11751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:54:21.399740 11749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:54:21.399742 11748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:54:21.399906 11742 server_base.cc:1034] running on GCE node
I20260806 15:54:21.400606 11742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:54:21.401647 11742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:54:21.402803 11742 hybrid_clock.cc:648] HybridClock initialized: now 1786031661402781 us; error 46 us; skew 500 ppm
I20260806 15:54:21.404626 11742 webserver.cc:460] Webserver started at http://127.10.189.254:40697/ using document root <none> and password file <none>
I20260806 15:54:21.405164 11742 fs_manager.cc:359] Metadata directory not provided
I20260806 15:54:21.405225 11742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:54:21.405390 11742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:54:21.407421 11742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "44dc93926e214c0e94244ae74e7906db"
format_stamp: "Formatted at 2026-08-06 15:54:21 on dist-test-slave-mn4r"
I20260806 15:54:21.407951 11742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "44dc93926e214c0e94244ae74e7906db"
format_stamp: "Formatted at 2026-08-06 15:54:21 on dist-test-slave-mn4r"
I20260806 15:54:21.411643 11742 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 15:54:21.414005 11758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:21.415290 11742 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 15:54:21.415432 11742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
uuid: "44dc93926e214c0e94244ae74e7906db"
format_stamp: "Formatted at 2026-08-06 15:54:21 on dist-test-slave-mn4r"
I20260806 15:54:21.415542 11742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:54:21.432339 11742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:54:21.433077 11742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:54:21.433305 11742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:54:21.440657 11742 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.254:39905
I20260806 15:54:21.440667 11812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.254:39905 every 8 connection(s)
I20260806 15:54:21.441643 11742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260806 15:54:21.445251 11813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:54:21.446312 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 11742
I20260806 15:54:21.446434 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260806 15:54:21.451735 11813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db: Bootstrap starting.
I20260806 15:54:21.454385 11813 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db: Neither blocks nor log segments found. Creating new log.
I20260806 15:54:21.455327 11813 log.cc:824] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db: Log is configured to *not* fsync() on all Append() calls
I20260806 15:54:21.457418 11813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db: No bootstrap required, opened a new log
I20260806 15:54:21.461205 11813 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44dc93926e214c0e94244ae74e7906db" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 39905 } }
I20260806 15:54:21.461418 11813 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:54:21.461460 11813 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44dc93926e214c0e94244ae74e7906db, State: Initialized, Role: FOLLOWER
I20260806 15:54:21.461810 11813 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44dc93926e214c0e94244ae74e7906db" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 39905 } }
I20260806 15:54:21.462000 11813 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:54:21.462071 11813 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:54:21.462217 11813 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:54:21.463217 11813 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44dc93926e214c0e94244ae74e7906db" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 39905 } }
I20260806 15:54:21.463521 11813 leader_election.cc:302] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44dc93926e214c0e94244ae74e7906db; no voters:
I20260806 15:54:21.463776 11813 leader_election.cc:288] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:54:21.463903 11818 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:54:21.464139 11818 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db [term 1 LEADER]: Becoming Leader. State: Replica: 44dc93926e214c0e94244ae74e7906db, State: Running, Role: LEADER
I20260806 15:54:21.464484 11818 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44dc93926e214c0e94244ae74e7906db" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 39905 } }
I20260806 15:54:21.465054 11813 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:54:21.466138 11820 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44dc93926e214c0e94244ae74e7906db. Latest consensus state: current_term: 1 leader_uuid: "44dc93926e214c0e94244ae74e7906db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44dc93926e214c0e94244ae74e7906db" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 39905 } } }
I20260806 15:54:21.466271 11820 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db [sys.catalog]: This master's current role is: LEADER
I20260806 15:54:21.466549 11819 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44dc93926e214c0e94244ae74e7906db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44dc93926e214c0e94244ae74e7906db" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 39905 } } }
I20260806 15:54:21.466634 11819 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db [sys.catalog]: This master's current role is: LEADER
I20260806 15:54:21.466665 11827 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:54:21.469358 11827 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:54:21.474979 11827 catalog_manager.cc:1347] Generated new cluster ID: f6a96fd54da94e44a9d8da2d32bec00a
I20260806 15:54:21.475045 11827 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:54:21.483829 11827 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:54:21.485044 11827 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:54:21.493580 11827 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44dc93926e214c0e94244ae74e7906db: Generated new TSK 0
I20260806 15:54:21.494475 11827 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:54:21.497633 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.193:0
--local_ip_for_outbound_sockets=127.10.189.193
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:39905
--builtin_ntp_servers=127.10.189.212:41649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=1000 with env {}
W20260806 15:54:21.612201 11837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:54:21.612478 11837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:54:21.612514 11837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:54:21.616698 11837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:54:21.616793 11837 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.193
I20260806 15:54:21.621652 11837 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:41649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=1000
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:39905
--never_fsync=true
--heap_profile_path=/tmp/kudu.11837
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.193
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:54:21.622731 11837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:54:21.624147 11837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:54:21.633538 11842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:54:21.633526 11845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:54:21.633525 11843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:54:21.633738 11837 server_base.cc:1034] running on GCE node
I20260806 15:54:21.634333 11837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:54:21.635052 11837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:54:21.636238 11837 hybrid_clock.cc:648] HybridClock initialized: now 1786031661636211 us; error 48 us; skew 500 ppm
I20260806 15:54:21.638255 11837 webserver.cc:460] Webserver started at http://127.10.189.193:40071/ using document root <none> and password file <none>
I20260806 15:54:21.638909 11837 fs_manager.cc:359] Metadata directory not provided
I20260806 15:54:21.639014 11837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:54:21.639279 11837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:54:21.641394 11837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "d8b92b7067f4454b9d744489b0e82c41"
format_stamp: "Formatted at 2026-08-06 15:54:21 on dist-test-slave-mn4r"
I20260806 15:54:21.642014 11837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "d8b92b7067f4454b9d744489b0e82c41"
format_stamp: "Formatted at 2026-08-06 15:54:21 on dist-test-slave-mn4r"
I20260806 15:54:21.645920 11837 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260806 15:54:21.648491 11852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:21.649974 11837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 15:54:21.650141 11837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "d8b92b7067f4454b9d744489b0e82c41"
format_stamp: "Formatted at 2026-08-06 15:54:21 on dist-test-slave-mn4r"
I20260806 15:54:21.650269 11837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:54:21.664213 11837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:54:21.664897 11837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:54:21.665103 11837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:54:21.665827 11837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:54:21.666986 11837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:54:21.667035 11837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:21.667114 11837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:54:21.667146 11837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:21.676767 11837 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.193:37289
I20260806 15:54:21.676832 11972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.193:37289 every 8 connection(s)
I20260806 15:54:21.678200 11837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260806 15:54:21.684623 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 11837
I20260806 15:54:21.684764 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260806 15:54:21.687309 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.194:0
--local_ip_for_outbound_sockets=127.10.189.194
--webserver_interface=127.10.189.194
--webserver_port=0
--tserver_master_addrs=127.10.189.254:39905
--builtin_ntp_servers=127.10.189.212:41649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=1000 with env {}
I20260806 15:54:21.691861 11973 heartbeater.cc:347] Connected to a master server at 127.10.189.254:39905
I20260806 15:54:21.692134 11973 heartbeater.cc:464] Registering TS with master...
I20260806 15:54:21.692684 11973 heartbeater.cc:511] Master 127.10.189.254:39905 requested a full tablet report, sending...
I20260806 15:54:21.694516 11776 ts_manager.cc:194] Registered new tserver with Master: d8b92b7067f4454b9d744489b0e82c41 (127.10.189.193:37289)
I20260806 15:54:21.696328 11776 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.193:35635
W20260806 15:54:21.799458 11976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:54:21.799698 11976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:54:21.799732 11976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:54:21.803591 11976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:54:21.803668 11976 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.194
I20260806 15:54:21.808213 11976 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:41649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=1000
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.10.189.194
--webserver_port=0
--tserver_master_addrs=127.10.189.254:39905
--never_fsync=true
--heap_profile_path=/tmp/kudu.11976
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.194
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:54:21.809223 11976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:54:21.810607 11976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:54:21.820237 11982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:54:21.820248 11981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:54:21.820482 11976 server_base.cc:1034] running on GCE node
W20260806 15:54:21.820259 11985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:54:21.820971 11976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:54:21.821659 11976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:54:21.822816 11976 hybrid_clock.cc:648] HybridClock initialized: now 1786031661822800 us; error 28 us; skew 500 ppm
I20260806 15:54:21.824662 11976 webserver.cc:460] Webserver started at http://127.10.189.194:36257/ using document root <none> and password file <none>
I20260806 15:54:21.825253 11976 fs_manager.cc:359] Metadata directory not provided
I20260806 15:54:21.825316 11976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:54:21.825554 11976 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:54:21.827503 11976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "c50d6c539f9646e089cfe3d1576e0486"
format_stamp: "Formatted at 2026-08-06 15:54:21 on dist-test-slave-mn4r"
I20260806 15:54:21.828074 11976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "c50d6c539f9646e089cfe3d1576e0486"
format_stamp: "Formatted at 2026-08-06 15:54:21 on dist-test-slave-mn4r"
I20260806 15:54:21.831744 11976 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 15:54:21.834204 11991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:21.835398 11976 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 15:54:21.835536 11976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "c50d6c539f9646e089cfe3d1576e0486"
format_stamp: "Formatted at 2026-08-06 15:54:21 on dist-test-slave-mn4r"
I20260806 15:54:21.835657 11976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:54:21.844810 11976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:54:21.845427 11976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:54:21.845613 11976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:54:21.846213 11976 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:54:21.847127 11976 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:54:21.847194 11976 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:21.847263 11976 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:54:21.847314 11976 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:21.856642 11976 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.194:34579
I20260806 15:54:21.856686 12112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.194:34579 every 8 connection(s)
I20260806 15:54:21.857520 11976 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260806 15:54:21.864140 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 11976
I20260806 15:54:21.864254 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260806 15:54:21.866627 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.195:0
--local_ip_for_outbound_sockets=127.10.189.195
--webserver_interface=127.10.189.195
--webserver_port=0
--tserver_master_addrs=127.10.189.254:39905
--builtin_ntp_servers=127.10.189.212:41649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=1000 with env {}
I20260806 15:54:21.868683 12113 heartbeater.cc:347] Connected to a master server at 127.10.189.254:39905
I20260806 15:54:21.868916 12113 heartbeater.cc:464] Registering TS with master...
I20260806 15:54:21.869434 12113 heartbeater.cc:511] Master 127.10.189.254:39905 requested a full tablet report, sending...
I20260806 15:54:21.870550 11776 ts_manager.cc:194] Registered new tserver with Master: c50d6c539f9646e089cfe3d1576e0486 (127.10.189.194:34579)
I20260806 15:54:21.871429 11776 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.194:45373
W20260806 15:54:21.983770 12116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:54:21.984030 12116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:54:21.984068 12116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:54:21.988180 12116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:54:21.988267 12116 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.195
I20260806 15:54:21.993053 12116 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:41649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=1000
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.189.195
--webserver_port=0
--tserver_master_addrs=127.10.189.254:39905
--never_fsync=true
--heap_profile_path=/tmp/kudu.12116
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.195
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:54:21.994292 12116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:54:21.995695 12116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:54:22.005156 12124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:54:22.005165 12121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:54:22.005339 12116 server_base.cc:1034] running on GCE node
W20260806 15:54:22.005172 12122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:54:22.005851 12116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:54:22.006562 12116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:54:22.007754 12116 hybrid_clock.cc:648] HybridClock initialized: now 1786031662007735 us; error 30 us; skew 500 ppm
I20260806 15:54:22.009585 12116 webserver.cc:460] Webserver started at http://127.10.189.195:40523/ using document root <none> and password file <none>
I20260806 15:54:22.010236 12116 fs_manager.cc:359] Metadata directory not provided
I20260806 15:54:22.010334 12116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:54:22.010577 12116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:54:22.012507 12116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "c51c87dbf21d4efc92179c92c7846314"
format_stamp: "Formatted at 2026-08-06 15:54:22 on dist-test-slave-mn4r"
I20260806 15:54:22.013080 12116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "c51c87dbf21d4efc92179c92c7846314"
format_stamp: "Formatted at 2026-08-06 15:54:22 on dist-test-slave-mn4r"
I20260806 15:54:22.017130 12116 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 15:54:22.019726 12130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:22.020998 12116 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 15:54:22.021129 12116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "c51c87dbf21d4efc92179c92c7846314"
format_stamp: "Formatted at 2026-08-06 15:54:22 on dist-test-slave-mn4r"
I20260806 15:54:22.021226 12116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:54:22.036195 12116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:54:22.036896 12116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:54:22.037104 12116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:54:22.037724 12116 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:54:22.038822 12116 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:54:22.038872 12116 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:22.038937 12116 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:54:22.038971 12116 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:22.047905 12116 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.195:46621
I20260806 15:54:22.047933 12255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.195:46621 every 8 connection(s)
I20260806 15:54:22.048939 12116 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260806 15:54:22.054443 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 12116
I20260806 15:54:22.054559 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260806 15:54:22.060046 12256 heartbeater.cc:347] Connected to a master server at 127.10.189.254:39905
I20260806 15:54:22.060249 12256 heartbeater.cc:464] Registering TS with master...
I20260806 15:54:22.060694 12256 heartbeater.cc:511] Master 127.10.189.254:39905 requested a full tablet report, sending...
I20260806 15:54:22.061625 11776 ts_manager.cc:194] Registered new tserver with Master: c51c87dbf21d4efc92179c92c7846314 (127.10.189.195:46621)
I20260806 15:54:22.062281 11776 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.195:54103
I20260806 15:54:22.068804 10999 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:54:22.079200 11776 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38202:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
W20260806 15:54:22.082521 11776 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:54:22.100243 12185 tablet_service.cc:1467] Processing CreateTablet for tablet 6bc0bd8a884a4a77ab022d59aa8c9271 (DEFAULT_TABLE table=TestTable [id=4ac6eb3327a947e9ae7f255e60af16a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:54:22.100497 11901 tablet_service.cc:1467] Processing CreateTablet for tablet 6bc0bd8a884a4a77ab022d59aa8c9271 (DEFAULT_TABLE table=TestTable [id=4ac6eb3327a947e9ae7f255e60af16a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:54:22.101285 12185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bc0bd8a884a4a77ab022d59aa8c9271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:54:22.101430 11901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bc0bd8a884a4a77ab022d59aa8c9271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:54:22.104898 12043 tablet_service.cc:1467] Processing CreateTablet for tablet 6bc0bd8a884a4a77ab022d59aa8c9271 (DEFAULT_TABLE table=TestTable [id=4ac6eb3327a947e9ae7f255e60af16a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:54:22.105904 12043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bc0bd8a884a4a77ab022d59aa8c9271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:54:22.107252 12274 tablet_bootstrap.cc:492] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314: Bootstrap starting.
I20260806 15:54:22.108578 12275 tablet_bootstrap.cc:492] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41: Bootstrap starting.
I20260806 15:54:22.110036 12274 tablet_bootstrap.cc:654] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314: Neither blocks nor log segments found. Creating new log.
I20260806 15:54:22.110793 12275 tablet_bootstrap.cc:654] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41: Neither blocks nor log segments found. Creating new log.
I20260806 15:54:22.110819 12274 log.cc:824] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314: Log is configured to *not* fsync() on all Append() calls
I20260806 15:54:22.111639 12275 log.cc:824] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41: Log is configured to *not* fsync() on all Append() calls
I20260806 15:54:22.112743 12278 tablet_bootstrap.cc:492] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c50d6c539f9646e089cfe3d1576e0486: Bootstrap starting.
I20260806 15:54:22.112778 12274 tablet_bootstrap.cc:492] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314: No bootstrap required, opened a new log
I20260806 15:54:22.113551 12275 tablet_bootstrap.cc:492] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41: No bootstrap required, opened a new log
I20260806 15:54:22.113623 12274 ts_tablet_manager.cc:1397] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260806 15:54:22.113817 12275 ts_tablet_manager.cc:1397] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260806 15:54:22.114981 12278 tablet_bootstrap.cc:654] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c50d6c539f9646e089cfe3d1576e0486: Neither blocks nor log segments found. Creating new log.
I20260806 15:54:22.115863 12278 log.cc:824] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c50d6c539f9646e089cfe3d1576e0486: Log is configured to *not* fsync() on all Append() calls
I20260806 15:54:22.117566 12275 raft_consensus.cc:348] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51c87dbf21d4efc92179c92c7846314" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 46621 } } peers { permanent_uuid: "c50d6c539f9646e089cfe3d1576e0486" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 34579 } } peers { permanent_uuid: "d8b92b7067f4454b9d744489b0e82c41" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 37289 } }
I20260806 15:54:22.117714 12278 tablet_bootstrap.cc:492] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c50d6c539f9646e089cfe3d1576e0486: No bootstrap required, opened a new log
I20260806 15:54:22.117800 12275 raft_consensus.cc:374] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:54:22.117872 12275 raft_consensus.cc:729] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8b92b7067f4454b9d744489b0e82c41, State: Initialized, Role: FOLLOWER
I20260806 15:54:22.117905 12278 ts_tablet_manager.cc:1397] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c50d6c539f9646e089cfe3d1576e0486: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260806 15:54:22.118225 12274 raft_consensus.cc:348] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51c87dbf21d4efc92179c92c7846314" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 46621 } } peers { permanent_uuid: "c50d6c539f9646e089cfe3d1576e0486" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 34579 } } peers { permanent_uuid: "d8b92b7067f4454b9d744489b0e82c41" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 37289 } }
I20260806 15:54:22.118472 12274 raft_consensus.cc:374] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:54:22.118392 12275 consensus_queue.cc:260] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51c87dbf21d4efc92179c92c7846314" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 46621 } } peers { permanent_uuid: "c50d6c539f9646e089cfe3d1576e0486" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 34579 } } peers { permanent_uuid: "d8b92b7067f4454b9d744489b0e82c41" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 37289 } }
I20260806 15:54:22.118584 12274 raft_consensus.cc:729] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51c87dbf21d4efc92179c92c7846314, State: Initialized, Role: FOLLOWER
I20260806 15:54:22.119095 11973 heartbeater.cc:503] Master 127.10.189.254:39905 was elected leader, sending a full tablet report...
I20260806 15:54:22.119074 12274 consensus_queue.cc:260] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51c87dbf21d4efc92179c92c7846314" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 46621 } } peers { permanent_uuid: "c50d6c539f9646e089cfe3d1576e0486" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 34579 } } peers { permanent_uuid: "d8b92b7067f4454b9d744489b0e82c41" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 37289 } }
I20260806 15:54:22.119447 12275 ts_tablet_manager.cc:1428] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260806 15:54:22.120494 12274 ts_tablet_manager.cc:1428] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260806 15:54:22.120883 12256 heartbeater.cc:503] Master 127.10.189.254:39905 was elected leader, sending a full tablet report...
I20260806 15:54:22.122488 12278 raft_consensus.cc:348] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c50d6c539f9646e089cfe3d1576e0486 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51c87dbf21d4efc92179c92c7846314" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 46621 } } peers { permanent_uuid: "c50d6c539f9646e089cfe3d1576e0486" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 34579 } } peers { permanent_uuid: "d8b92b7067f4454b9d744489b0e82c41" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 37289 } }
I20260806 15:54:22.122786 12278 raft_consensus.cc:374] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c50d6c539f9646e089cfe3d1576e0486 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:54:22.122891 12278 raft_consensus.cc:729] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c50d6c539f9646e089cfe3d1576e0486 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c50d6c539f9646e089cfe3d1576e0486, State: Initialized, Role: FOLLOWER
I20260806 15:54:22.123447 12278 consensus_queue.cc:260] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c50d6c539f9646e089cfe3d1576e0486 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51c87dbf21d4efc92179c92c7846314" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 46621 } } peers { permanent_uuid: "c50d6c539f9646e089cfe3d1576e0486" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 34579 } } peers { permanent_uuid: "d8b92b7067f4454b9d744489b0e82c41" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 37289 } }
I20260806 15:54:22.124608 12278 ts_tablet_manager.cc:1428] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c50d6c539f9646e089cfe3d1576e0486: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260806 15:54:22.124563 12113 heartbeater.cc:503] Master 127.10.189.254:39905 was elected leader, sending a full tablet report...
W20260806 15:54:22.182413 11974 tablet.cc:2369] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 15:54:22.299976 12257 tablet.cc:2369] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:54:22.317920 12280 raft_consensus.cc:482] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:54:22.318239 12280 raft_consensus.cc:504] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51c87dbf21d4efc92179c92c7846314" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 46621 } } peers { permanent_uuid: "c50d6c539f9646e089cfe3d1576e0486" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 34579 } } peers { permanent_uuid: "d8b92b7067f4454b9d744489b0e82c41" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 37289 } }
I20260806 15:54:22.319487 12280 leader_election.cc:288] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51c87dbf21d4efc92179c92c7846314 (127.10.189.195:46621), c50d6c539f9646e089cfe3d1576e0486 (127.10.189.194:34579)
I20260806 15:54:22.324242 12206 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bc0bd8a884a4a77ab022d59aa8c9271" candidate_uuid: "d8b92b7067f4454b9d744489b0e82c41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51c87dbf21d4efc92179c92c7846314" is_pre_election: true
I20260806 15:54:22.324342 12066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bc0bd8a884a4a77ab022d59aa8c9271" candidate_uuid: "d8b92b7067f4454b9d744489b0e82c41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c50d6c539f9646e089cfe3d1576e0486" is_pre_election: true
I20260806 15:54:22.324579 12206 raft_consensus.cc:2454] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8b92b7067f4454b9d744489b0e82c41 in term 0.
I20260806 15:54:22.324712 12066 raft_consensus.cc:2454] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c50d6c539f9646e089cfe3d1576e0486 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8b92b7067f4454b9d744489b0e82c41 in term 0.
I20260806 15:54:22.325138 11857 leader_election.cc:302] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51c87dbf21d4efc92179c92c7846314, d8b92b7067f4454b9d744489b0e82c41; no voters:
I20260806 15:54:22.325423 12280 raft_consensus.cc:2781] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:54:22.325560 12280 raft_consensus.cc:482] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:54:22.325624 12280 raft_consensus.cc:3037] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:54:22.326785 12280 raft_consensus.cc:504] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51c87dbf21d4efc92179c92c7846314" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 46621 } } peers { permanent_uuid: "c50d6c539f9646e089cfe3d1576e0486" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 34579 } } peers { permanent_uuid: "d8b92b7067f4454b9d744489b0e82c41" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 37289 } }
I20260806 15:54:22.327132 12280 leader_election.cc:288] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [CANDIDATE]: Term 1 election: Requested vote from peers c51c87dbf21d4efc92179c92c7846314 (127.10.189.195:46621), c50d6c539f9646e089cfe3d1576e0486 (127.10.189.194:34579)
I20260806 15:54:22.327492 12206 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bc0bd8a884a4a77ab022d59aa8c9271" candidate_uuid: "d8b92b7067f4454b9d744489b0e82c41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51c87dbf21d4efc92179c92c7846314"
I20260806 15:54:22.327553 12066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bc0bd8a884a4a77ab022d59aa8c9271" candidate_uuid: "d8b92b7067f4454b9d744489b0e82c41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c50d6c539f9646e089cfe3d1576e0486"
I20260806 15:54:22.327633 12206 raft_consensus.cc:3037] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:54:22.327812 12066 raft_consensus.cc:3037] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c50d6c539f9646e089cfe3d1576e0486 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:54:22.328609 12206 raft_consensus.cc:2454] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8b92b7067f4454b9d744489b0e82c41 in term 1.
I20260806 15:54:22.328893 11857 leader_election.cc:302] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51c87dbf21d4efc92179c92c7846314, d8b92b7067f4454b9d744489b0e82c41; no voters:
I20260806 15:54:22.329001 12066 raft_consensus.cc:2454] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c50d6c539f9646e089cfe3d1576e0486 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8b92b7067f4454b9d744489b0e82c41 in term 1.
I20260806 15:54:22.329073 12280 raft_consensus.cc:2781] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:54:22.329320 12280 raft_consensus.cc:686] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [term 1 LEADER]: Becoming Leader. State: Replica: d8b92b7067f4454b9d744489b0e82c41, State: Running, Role: LEADER
I20260806 15:54:22.329684 12280 consensus_queue.cc:237] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51c87dbf21d4efc92179c92c7846314" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 46621 } } peers { permanent_uuid: "c50d6c539f9646e089cfe3d1576e0486" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 34579 } } peers { permanent_uuid: "d8b92b7067f4454b9d744489b0e82c41" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 37289 } }
I20260806 15:54:22.332787 11776 catalog_manager.cc:5495] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8b92b7067f4454b9d744489b0e82c41 (127.10.189.193). New cstate: current_term: 1 leader_uuid: "d8b92b7067f4454b9d744489b0e82c41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51c87dbf21d4efc92179c92c7846314" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 46621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c50d6c539f9646e089cfe3d1576e0486" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 34579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8b92b7067f4454b9d744489b0e82c41" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 37289 } health_report { overall_health: HEALTHY } } }
W20260806 15:54:22.358714 12114 tablet.cc:2369] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c50d6c539f9646e089cfe3d1576e0486: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:54:22.388703 10999 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:54:22.391083 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver d8b92b7067f4454b9d744489b0e82c41 to finish bootstrapping
I20260806 15:54:22.397034 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver c50d6c539f9646e089cfe3d1576e0486 to finish bootstrapping
I20260806 15:54:22.402292 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver c51c87dbf21d4efc92179c92c7846314 to finish bootstrapping
I20260806 15:54:22.431732 12066 raft_consensus.cc:1261] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c50d6c539f9646e089cfe3d1576e0486 [term 1 FOLLOWER]: Refusing update from remote peer d8b92b7067f4454b9d744489b0e82c41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:54:22.431732 12206 raft_consensus.cc:1261] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314 [term 1 FOLLOWER]: Refusing update from remote peer d8b92b7067f4454b9d744489b0e82c41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:54:22.432472 12280 consensus_queue.cc:1035] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51c87dbf21d4efc92179c92c7846314" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 46621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:54:22.432678 12285 consensus_queue.cc:1035] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c50d6c539f9646e089cfe3d1576e0486" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 34579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:54:22.442171 12290 mvcc.cc:205] Tried to move back new op lower bound from 7315585689311944704 to 7315585688905170944. Current Snapshot: MvccSnapshot[applied={T|T < 7315585689311944704}]
I20260806 15:54:22.451210 12291 mvcc.cc:205] Tried to move back new op lower bound from 7315585689311944704 to 7315585688905170944. Current Snapshot: MvccSnapshot[applied={T|T < 7315585689311944704}]
I20260806 15:54:22.545081 11901 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260806 15:54:22.545267 12043 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260806 15:54:22.545735 12185 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
44dc93926e214c0e94244ae74e7906db | 127.10.189.254:39905 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.189.212:41649 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
c50d6c539f9646e089cfe3d1576e0486 | 127.10.189.194:34579 | HEALTHY | <none> | 0 | 0
c51c87dbf21d4efc92179c92c7846314 | 127.10.189.195:46621 | HEALTHY | <none> | 0 | 0
d8b92b7067f4454b9d744489b0e82c41 | 127.10.189.193:37289 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.10.189.193 | experimental | 127.10.189.193:37289
local_ip_for_outbound_sockets | 127.10.189.194 | experimental | 127.10.189.194:34579
local_ip_for_outbound_sockets | 127.10.189.195 | experimental | 127.10.189.195:46621
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.10.189.193:37289
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.10.189.194:34579
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.10.189.195:46621
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.189.212:41649 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-----------+----+---------+---------------+---------+------------+------------------+-------------
TestTable | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260806 15:54:22.573673 10999 log_verifier.cc:126] Checking tablet 6bc0bd8a884a4a77ab022d59aa8c9271
I20260806 15:54:22.616441 10999 log_verifier.cc:177] Verified matching terms for 6 ops in tablet 6bc0bd8a884a4a77ab022d59aa8c9271
I20260806 15:54:22.657665 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 11837
I20260806 15:54:22.665660 12206 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6bc0bd8a884a4a77ab022d59aa8c9271"
dest_uuid: "c51c87dbf21d4efc92179c92c7846314"
from {username='slave'} at 127.0.0.1:57882
I20260806 15:54:22.665932 12206 raft_consensus.cc:482] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:54:22.666113 12206 raft_consensus.cc:3037] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:54:22.667098 12206 raft_consensus.cc:504] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51c87dbf21d4efc92179c92c7846314" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 46621 } } peers { permanent_uuid: "c50d6c539f9646e089cfe3d1576e0486" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 34579 } } peers { permanent_uuid: "d8b92b7067f4454b9d744489b0e82c41" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 37289 } }
I20260806 15:54:22.668146 12206 leader_election.cc:288] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314 [CANDIDATE]: Term 2 election: Requested vote from peers c50d6c539f9646e089cfe3d1576e0486 (127.10.189.194:34579), d8b92b7067f4454b9d744489b0e82c41 (127.10.189.193:37289)
W20260806 15:54:22.669334 12136 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.189.193:37289: connect: Connection refused (error 111)
W20260806 15:54:22.670270 12136 leader_election.cc:334] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d8b92b7067f4454b9d744489b0e82c41 (127.10.189.193:37289): Network error: Client connection negotiation failed: client connection to 127.10.189.193:37289: connect: Connection refused (error 111)
I20260806 15:54:22.672803 12066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bc0bd8a884a4a77ab022d59aa8c9271" candidate_uuid: "c51c87dbf21d4efc92179c92c7846314" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: true dest_uuid: "c50d6c539f9646e089cfe3d1576e0486"
I20260806 15:54:22.672924 12066 raft_consensus.cc:3037] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c50d6c539f9646e089cfe3d1576e0486 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:54:22.673986 12066 raft_consensus.cc:2454] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c50d6c539f9646e089cfe3d1576e0486 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51c87dbf21d4efc92179c92c7846314 in term 2.
I20260806 15:54:22.674371 12136 leader_election.cc:302] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c50d6c539f9646e089cfe3d1576e0486, c51c87dbf21d4efc92179c92c7846314; no voters: d8b92b7067f4454b9d744489b0e82c41
I20260806 15:54:22.674643 12281 raft_consensus.cc:2781] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 15:54:22.674837 12281 raft_consensus.cc:686] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314 [term 2 LEADER]: Becoming Leader. State: Replica: c51c87dbf21d4efc92179c92c7846314, State: Running, Role: LEADER
I20260806 15:54:22.675148 12281 consensus_queue.cc:237] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51c87dbf21d4efc92179c92c7846314" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 46621 } } peers { permanent_uuid: "c50d6c539f9646e089cfe3d1576e0486" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 34579 } } peers { permanent_uuid: "d8b92b7067f4454b9d744489b0e82c41" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 37289 } }
W20260806 15:54:22.676059 12262 meta_cache.cc:302] tablet 6bc0bd8a884a4a77ab022d59aa8c9271: replica d8b92b7067f4454b9d744489b0e82c41 (127.10.189.193:37289) has failed: Network error: Client connection negotiation failed: client connection to 127.10.189.193:37289: connect: Connection refused (error 111)
I20260806 15:54:22.677161 11774 catalog_manager.cc:5495] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314 reported cstate change: term changed from 1 to 2, leader changed from d8b92b7067f4454b9d744489b0e82c41 (127.10.189.193) to c51c87dbf21d4efc92179c92c7846314 (127.10.189.195). New cstate: current_term: 2 leader_uuid: "c51c87dbf21d4efc92179c92c7846314" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51c87dbf21d4efc92179c92c7846314" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 46621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c50d6c539f9646e089cfe3d1576e0486" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 34579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8b92b7067f4454b9d744489b0e82c41" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 37289 } health_report { overall_health: UNKNOWN } } }
I20260806 15:54:22.686420 12066 raft_consensus.cc:1261] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c50d6c539f9646e089cfe3d1576e0486 [term 2 FOLLOWER]: Refusing update from remote peer c51c87dbf21d4efc92179c92c7846314: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260806 15:54:22.686954 12281 consensus_queue.cc:1035] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c50d6c539f9646e089cfe3d1576e0486" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 34579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260806 15:54:22.687162 12136 consensus_peers.cc:487] T 6bc0bd8a884a4a77ab022d59aa8c9271 P c51c87dbf21d4efc92179c92c7846314 -> Peer d8b92b7067f4454b9d744489b0e82c41 (127.10.189.193:37289): Couldn't send request to peer d8b92b7067f4454b9d744489b0e82c41. Status: Network error: Client connection negotiation failed: client connection to 127.10.189.193:37289: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 15:54:22.725018 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.193:37289
--local_ip_for_outbound_sockets=127.10.189.193
--tserver_master_addrs=127.10.189.254:39905
--webserver_port=40071
--webserver_interface=127.10.189.193
--builtin_ntp_servers=127.10.189.212:41649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=1000 with env {}
W20260806 15:54:22.839704 12339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:54:22.840045 12339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:54:22.840090 12339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:54:22.844276 12339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:54:22.844372 12339 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.193
I20260806 15:54:22.849228 12339 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:41649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=1000
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.193:37289
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.10.189.193
--webserver_port=40071
--tserver_master_addrs=127.10.189.254:39905
--never_fsync=true
--heap_profile_path=/tmp/kudu.12339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.193
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:54:22.850482 12339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:54:22.852042 12339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:54:22.861992 12344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:54:22.861989 12349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:54:22.861989 12345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:54:22.862424 12339 server_base.cc:1034] running on GCE node
I20260806 15:54:22.862998 12339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:54:22.863791 12339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:54:22.864995 12339 hybrid_clock.cc:648] HybridClock initialized: now 1786031662864944 us; error 57 us; skew 500 ppm
I20260806 15:54:22.867465 12339 webserver.cc:460] Webserver started at http://127.10.189.193:40071/ using document root <none> and password file <none>
I20260806 15:54:22.868186 12339 fs_manager.cc:359] Metadata directory not provided
I20260806 15:54:22.868291 12339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:54:22.873112 12339 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 15:54:22.875712 12355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:22.877048 12339 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 15:54:22.877197 12339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "d8b92b7067f4454b9d744489b0e82c41"
format_stamp: "Formatted at 2026-08-06 15:54:21 on dist-test-slave-mn4r"
I20260806 15:54:22.877768 12339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:54:22.891717 12339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:54:22.892483 12339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:54:22.892696 12339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:54:22.893328 12339 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:54:22.894646 12362 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 15:54:22.898968 12339 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 15:54:22.899158 12339 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260806 15:54:22.899273 12339 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 15:54:22.900915 12339 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 15:54:22.901000 12339 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260806 15:54:22.901258 12362 tablet_bootstrap.cc:492] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41: Bootstrap starting.
I20260806 15:54:22.911496 12339 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.193:37289
I20260806 15:54:22.911576 12474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.193:37289 every 8 connection(s)
I20260806 15:54:22.912590 12339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260806 15:54:22.915702 12362 log.cc:824] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41: Log is configured to *not* fsync() on all Append() calls
I20260806 15:54:22.922909 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 12339
I20260806 15:54:22.923226 12475 heartbeater.cc:347] Connected to a master server at 127.10.189.254:39905
I20260806 15:54:22.923467 12475 heartbeater.cc:464] Registering TS with master...
I20260806 15:54:22.924088 12475 heartbeater.cc:511] Master 127.10.189.254:39905 requested a full tablet report, sending...
I20260806 15:54:22.926291 11774 ts_manager.cc:194] Re-registered known tserver with Master: d8b92b7067f4454b9d744489b0e82c41 (127.10.189.193:37289)
I20260806 15:54:22.927273 11774 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.193:52605
I20260806 15:54:22.937207 12362 tablet_bootstrap.cc:492] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=500 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 15:54:22.937665 12362 tablet_bootstrap.cc:492] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41: Bootstrap complete.
I20260806 15:54:22.938833 12362 ts_tablet_manager.cc:1397] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41: Time spent bootstrapping tablet: real 0.038s user 0.029s sys 0.008s
I20260806 15:54:22.941478 12362 raft_consensus.cc:348] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51c87dbf21d4efc92179c92c7846314" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 46621 } } peers { permanent_uuid: "c50d6c539f9646e089cfe3d1576e0486" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 34579 } } peers { permanent_uuid: "d8b92b7067f4454b9d744489b0e82c41" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 37289 } }
I20260806 15:54:22.941947 12362 raft_consensus.cc:729] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8b92b7067f4454b9d744489b0e82c41, State: Initialized, Role: FOLLOWER
I20260806 15:54:22.942489 12362 consensus_queue.cc:260] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51c87dbf21d4efc92179c92c7846314" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 46621 } } peers { permanent_uuid: "c50d6c539f9646e089cfe3d1576e0486" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 34579 } } peers { permanent_uuid: "d8b92b7067f4454b9d744489b0e82c41" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 37289 } }
I20260806 15:54:22.943230 12475 heartbeater.cc:503] Master 127.10.189.254:39905 was elected leader, sending a full tablet report...
I20260806 15:54:22.943521 12362 ts_tablet_manager.cc:1428] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260806 15:54:22.976229 12043 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260806 15:54:22.976436 12185 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260806 15:54:22.984920 12405 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
44dc93926e214c0e94244ae74e7906db | 127.10.189.254:39905 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.189.212:41649 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
c50d6c539f9646e089cfe3d1576e0486 | 127.10.189.194:34579 | HEALTHY | <none> | 0 | 0
c51c87dbf21d4efc92179c92c7846314 | 127.10.189.195:46621 | HEALTHY | <none> | 1 | 0
d8b92b7067f4454b9d744489b0e82c41 | 127.10.189.193:37289 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.10.189.193 | experimental | 127.10.189.193:37289
local_ip_for_outbound_sockets | 127.10.189.194 | experimental | 127.10.189.194:34579
local_ip_for_outbound_sockets | 127.10.189.195 | experimental | 127.10.189.195:46621
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.10.189.193:37289
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.10.189.194:34579
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.10.189.195:46621
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.189.212:41649 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet 6bc0bd8a884a4a77ab022d59aa8c9271 of table 'TestTable' is conflicted: 1 replicas' active configs disagree with the leader master's
c51c87dbf21d4efc92179c92c7846314 (127.10.189.195:46621): RUNNING [LEADER]
c50d6c539f9646e089cfe3d1576e0486 (127.10.189.194:34579): RUNNING
d8b92b7067f4454b9d744489b0e82c41 (127.10.189.193:37289): RUNNING
All reported replicas are:
A = c51c87dbf21d4efc92179c92c7846314
B = c50d6c539f9646e089cfe3d1576e0486
C = d8b92b7067f4454b9d744489b0e82c41
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
master | A* B C | | | Yes
A | A* B C | 2 | -1 | Yes
B | A* B C | 2 | -1 | Yes
C | A B C | 1 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-----------+----+--------------------+---------------+---------+------------+------------------+-------------
TestTable | 3 | CONSENSUS_MISMATCH | 1 | 0 | 0 | 0 | 1
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260806 15:54:23.005445 10999 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260806 15:54:23.204470 12043 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260806 15:54:23.204691 12185 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260806 15:54:23.206065 12405 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
44dc93926e214c0e94244ae74e7906db | 127.10.189.254:39905 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.189.212:41649 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
c50d6c539f9646e089cfe3d1576e0486 | 127.10.189.194:34579 | HEALTHY | <none> | 0 | 0
c51c87dbf21d4efc92179c92c7846314 | 127.10.189.195:46621 | HEALTHY | <none> | 1 | 0
d8b92b7067f4454b9d744489b0e82c41 | 127.10.189.193:37289 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.10.189.193 | experimental | 127.10.189.193:37289
local_ip_for_outbound_sockets | 127.10.189.194 | experimental | 127.10.189.194:34579
local_ip_for_outbound_sockets | 127.10.189.195 | experimental | 127.10.189.195:46621
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.10.189.193:37289
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.10.189.194:34579
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.10.189.195:46621
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.189.212:41649 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet 6bc0bd8a884a4a77ab022d59aa8c9271 of table 'TestTable' is conflicted: 1 replicas' active configs disagree with the leader master's
c51c87dbf21d4efc92179c92c7846314 (127.10.189.195:46621): RUNNING [LEADER]
c50d6c539f9646e089cfe3d1576e0486 (127.10.189.194:34579): RUNNING
d8b92b7067f4454b9d744489b0e82c41 (127.10.189.193:37289): RUNNING
All reported replicas are:
A = c51c87dbf21d4efc92179c92c7846314
B = c50d6c539f9646e089cfe3d1576e0486
C = d8b92b7067f4454b9d744489b0e82c41
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
master | A* B C | | | Yes
A | A* B C | 2 | -1 | Yes
B | A* B C | 2 | -1 | Yes
C | A B C | 1 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-----------+----+--------------------+---------------+---------+------------+------------------+-------------
TestTable | 3 | CONSENSUS_MISMATCH | 1 | 0 | 0 | 0 | 1
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260806 15:54:23.229331 10999 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260806 15:54:23.311779 12425 raft_consensus.cc:3037] T 6bc0bd8a884a4a77ab022d59aa8c9271 P d8b92b7067f4454b9d744489b0e82c41 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:54:23.321220 12532 mvcc.cc:205] Tried to move back new op lower bound from 7315585690502975488 to 7315585690319605760. Current Snapshot: MvccSnapshot[applied={T|T < 7315585690407325696}]
I20260806 15:54:23.505188 12043 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260806 15:54:23.505215 12405 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260806 15:54:23.505317 12185 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
44dc93926e214c0e94244ae74e7906db | 127.10.189.254:39905 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.189.212:41649 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
c50d6c539f9646e089cfe3d1576e0486 | 127.10.189.194:34579 | HEALTHY | <none> | 0 | 0
c51c87dbf21d4efc92179c92c7846314 | 127.10.189.195:46621 | HEALTHY | <none> | 1 | 0
d8b92b7067f4454b9d744489b0e82c41 | 127.10.189.193:37289 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.10.189.193 | experimental | 127.10.189.193:37289
local_ip_for_outbound_sockets | 127.10.189.194 | experimental | 127.10.189.194:34579
local_ip_for_outbound_sockets | 127.10.189.195 | experimental | 127.10.189.195:46621
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.10.189.193:37289
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.10.189.194:34579
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.10.189.195:46621
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.189.212:41649 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-----------+----+---------+---------------+---------+------------+------------------+-------------
TestTable | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260806 15:54:23.534049 10999 log_verifier.cc:126] Checking tablet 6bc0bd8a884a4a77ab022d59aa8c9271
I20260806 15:54:23.557466 10999 log_verifier.cc:177] Verified matching terms for 12 ops in tablet 6bc0bd8a884a4a77ab022d59aa8c9271
I20260806 15:54:23.761201 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 12339
I20260806 15:54:23.768114 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 11976
I20260806 15:54:23.774555 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 12116
I20260806 15:54:23.780872 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 11742
2026-08-06T15:54:23Z chronyd exiting
[ OK ] RaftConsensusElectionITest.RunLeaderElection (2556 ms)
[ RUN ] RaftConsensusElectionITest.ChurnyElections
I20260806 15:54:23.805742 10999 test_util.cc:268] Using random seed: -421464791
I20260806 15:54:23.806618 10999 ts_itest-base.cc:112] Starting cluster with:
I20260806 15:54:23.806680 10999 ts_itest-base.cc:113] --------------
I20260806 15:54:23.806700 10999 ts_itest-base.cc:114] 3 tablet servers
I20260806 15:54:23.806727 10999 ts_itest-base.cc:115] 3 replicas per TS
I20260806 15:54:23.806751 10999 ts_itest-base.cc:116] --------------
2026-08-06T15:54:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:54:23Z Disabled control of system clock
I20260806 15:54:23.816260 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:44849
--webserver_interface=127.10.189.254
--webserver_port=0
--builtin_ntp_servers=127.10.189.212:38363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.189.254:44849 with env {}
W20260806 15:54:23.925505 12578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:54:23.925841 12578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:54:23.925916 12578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:54:23.929903 12578 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:54:23.930002 12578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:54:23.930038 12578 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:54:23.930090 12578 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:54:23.934814 12578 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:38363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.189.254:44849
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:44849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.10.189.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.12578
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:54:23.935958 12578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:54:23.937472 12578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:54:23.945858 12584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:54:23.945966 12578 server_base.cc:1034] running on GCE node
W20260806 15:54:23.945851 12583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:54:23.945851 12586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:54:23.946704 12578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:54:23.947777 12578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:54:23.948966 12578 hybrid_clock.cc:648] HybridClock initialized: now 1786031663948955 us; error 32 us; skew 500 ppm
I20260806 15:54:23.950866 12578 webserver.cc:460] Webserver started at http://127.10.189.254:40999/ using document root <none> and password file <none>
I20260806 15:54:23.951455 12578 fs_manager.cc:359] Metadata directory not provided
I20260806 15:54:23.951550 12578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:54:23.951783 12578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:54:23.953666 12578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "72282d82fa1e456181cc326922d6f1d0"
format_stamp: "Formatted at 2026-08-06 15:54:23 on dist-test-slave-mn4r"
I20260806 15:54:23.954350 12578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "72282d82fa1e456181cc326922d6f1d0"
format_stamp: "Formatted at 2026-08-06 15:54:23 on dist-test-slave-mn4r"
I20260806 15:54:23.958191 12578 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 15:54:23.960645 12592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:23.961817 12578 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 15:54:23.961977 12578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
uuid: "72282d82fa1e456181cc326922d6f1d0"
format_stamp: "Formatted at 2026-08-06 15:54:23 on dist-test-slave-mn4r"
I20260806 15:54:23.962121 12578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:54:23.980010 12578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:54:23.980755 12578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:54:23.980962 12578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:54:23.987877 12578 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.254:44849
I20260806 15:54:23.987891 12648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.254:44849 every 8 connection(s)
I20260806 15:54:23.988807 12578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260806 15:54:23.991699 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 12578
I20260806 15:54:23.991838 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260806 15:54:23.992338 12649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:54:23.999156 12649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0: Bootstrap starting.
I20260806 15:54:24.001868 12649 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0: Neither blocks nor log segments found. Creating new log.
I20260806 15:54:24.002652 12649 log.cc:824] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0: Log is configured to *not* fsync() on all Append() calls
I20260806 15:54:24.004369 12649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0: No bootstrap required, opened a new log
I20260806 15:54:24.007951 12649 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72282d82fa1e456181cc326922d6f1d0" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 44849 } }
I20260806 15:54:24.008198 12649 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:54:24.008280 12649 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72282d82fa1e456181cc326922d6f1d0, State: Initialized, Role: FOLLOWER
I20260806 15:54:24.008694 12649 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72282d82fa1e456181cc326922d6f1d0" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 44849 } }
I20260806 15:54:24.008843 12649 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:54:24.008929 12649 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:54:24.009027 12649 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:54:24.009826 12649 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72282d82fa1e456181cc326922d6f1d0" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 44849 } }
I20260806 15:54:24.010228 12649 leader_election.cc:302] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72282d82fa1e456181cc326922d6f1d0; no voters:
I20260806 15:54:24.010533 12649 leader_election.cc:288] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:54:24.010655 12654 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:54:24.010941 12654 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0 [term 1 LEADER]: Becoming Leader. State: Replica: 72282d82fa1e456181cc326922d6f1d0, State: Running, Role: LEADER
I20260806 15:54:24.011248 12654 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72282d82fa1e456181cc326922d6f1d0" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 44849 } }
I20260806 15:54:24.011787 12649 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:54:24.013000 12655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72282d82fa1e456181cc326922d6f1d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72282d82fa1e456181cc326922d6f1d0" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 44849 } } }
I20260806 15:54:24.013123 12655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0 [sys.catalog]: This master's current role is: LEADER
I20260806 15:54:24.013906 12663 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:54:24.013924 12656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72282d82fa1e456181cc326922d6f1d0. Latest consensus state: current_term: 1 leader_uuid: "72282d82fa1e456181cc326922d6f1d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72282d82fa1e456181cc326922d6f1d0" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 44849 } } }
I20260806 15:54:24.014592 12656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0 [sys.catalog]: This master's current role is: LEADER
I20260806 15:54:24.016633 12663 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:54:24.022342 12663 catalog_manager.cc:1347] Generated new cluster ID: a432bb3859f94bb5b19d2bc1325c5a76
I20260806 15:54:24.022408 12663 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:54:24.037985 12663 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:54:24.039315 12663 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:54:24.051780 12663 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72282d82fa1e456181cc326922d6f1d0: Generated new TSK 0
I20260806 15:54:24.052662 12663 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:54:24.057713 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.193:0
--local_ip_for_outbound_sockets=127.10.189.193
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:44849
--builtin_ntp_servers=127.10.189.212:38363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--inject_latency_ms_before_starting_op=1000 with env {}
W20260806 15:54:24.173732 12673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:54:24.173988 12673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:54:24.174026 12673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:54:24.178047 12673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:54:24.178164 12673 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.193
I20260806 15:54:24.182979 12673 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:38363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.10.189.193
--webserver_port=0
--inject_latency_ms_before_starting_op=1000
--tserver_master_addrs=127.10.189.254:44849
--never_fsync=true
--heap_profile_path=/tmp/kudu.12673
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.193
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:54:24.184158 12673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:54:24.185601 12673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:54:24.195289 12681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:54:24.195328 12678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:54:24.195247 12679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:54:24.195611 12673 server_base.cc:1034] running on GCE node
I20260806 15:54:24.196077 12673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:54:24.196707 12673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:54:24.197870 12673 hybrid_clock.cc:648] HybridClock initialized: now 1786031664197855 us; error 25 us; skew 500 ppm
I20260806 15:54:24.199656 12673 webserver.cc:460] Webserver started at http://127.10.189.193:37979/ using document root <none> and password file <none>
I20260806 15:54:24.200176 12673 fs_manager.cc:359] Metadata directory not provided
I20260806 15:54:24.200235 12673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:54:24.200397 12673 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:54:24.202414 12673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "769d1af7b1c64960bd428b93f7b92aeb"
format_stamp: "Formatted at 2026-08-06 15:54:24 on dist-test-slave-mn4r"
I20260806 15:54:24.202929 12673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "769d1af7b1c64960bd428b93f7b92aeb"
format_stamp: "Formatted at 2026-08-06 15:54:24 on dist-test-slave-mn4r"
I20260806 15:54:24.206651 12673 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 15:54:24.209338 12687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:24.210685 12673 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 15:54:24.210812 12673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "769d1af7b1c64960bd428b93f7b92aeb"
format_stamp: "Formatted at 2026-08-06 15:54:24 on dist-test-slave-mn4r"
I20260806 15:54:24.210914 12673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:54:24.227695 12673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:54:24.228437 12673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:54:24.228637 12673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:54:24.229252 12673 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:54:24.230249 12673 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:54:24.230297 12673 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:24.230370 12673 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:54:24.230399 12673 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:24.239892 12673 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.193:42313
I20260806 15:54:24.239915 12808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.193:42313 every 8 connection(s)
I20260806 15:54:24.240806 12673 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260806 15:54:24.244802 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 12673
I20260806 15:54:24.244926 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260806 15:54:24.247324 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.194:0
--local_ip_for_outbound_sockets=127.10.189.194
--webserver_interface=127.10.189.194
--webserver_port=0
--tserver_master_addrs=127.10.189.254:44849
--builtin_ntp_servers=127.10.189.212:38363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--inject_latency_ms_before_starting_op=1000 with env {}
I20260806 15:54:24.252221 12810 heartbeater.cc:347] Connected to a master server at 127.10.189.254:44849
I20260806 15:54:24.252485 12810 heartbeater.cc:464] Registering TS with master...
I20260806 15:54:24.253015 12810 heartbeater.cc:511] Master 127.10.189.254:44849 requested a full tablet report, sending...
I20260806 15:54:24.254860 12611 ts_manager.cc:194] Registered new tserver with Master: 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:24.256682 12611 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.193:33727
W20260806 15:54:24.360874 12813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:54:24.361106 12813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:54:24.361142 12813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:54:24.365175 12813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:54:24.365295 12813 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.194
I20260806 15:54:24.369905 12813 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:38363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.10.189.194
--webserver_port=0
--inject_latency_ms_before_starting_op=1000
--tserver_master_addrs=127.10.189.254:44849
--never_fsync=true
--heap_profile_path=/tmp/kudu.12813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.194
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:54:24.370960 12813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:54:24.372334 12813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:54:24.381618 12818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:54:24.381637 12821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:54:24.381749 12813 server_base.cc:1034] running on GCE node
W20260806 15:54:24.381601 12819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:54:24.382308 12813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:54:24.382985 12813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:54:24.384167 12813 hybrid_clock.cc:648] HybridClock initialized: now 1786031664384151 us; error 26 us; skew 500 ppm
I20260806 15:54:24.386034 12813 webserver.cc:460] Webserver started at http://127.10.189.194:33533/ using document root <none> and password file <none>
I20260806 15:54:24.386646 12813 fs_manager.cc:359] Metadata directory not provided
I20260806 15:54:24.386739 12813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:54:24.386951 12813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:54:24.388816 12813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "83af84deafa34359afbc84e4438dc8e9"
format_stamp: "Formatted at 2026-08-06 15:54:24 on dist-test-slave-mn4r"
I20260806 15:54:24.389377 12813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "83af84deafa34359afbc84e4438dc8e9"
format_stamp: "Formatted at 2026-08-06 15:54:24 on dist-test-slave-mn4r"
I20260806 15:54:24.393014 12813 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260806 15:54:24.395560 12827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:24.396804 12813 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 15:54:24.396941 12813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "83af84deafa34359afbc84e4438dc8e9"
format_stamp: "Formatted at 2026-08-06 15:54:24 on dist-test-slave-mn4r"
I20260806 15:54:24.397053 12813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:54:24.409379 12813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:54:24.410019 12813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:54:24.410243 12813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:54:24.410812 12813 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:54:24.411834 12813 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:54:24.411901 12813 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:24.411971 12813 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:54:24.412022 12813 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:24.420833 12813 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.194:40645
I20260806 15:54:24.420855 12949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.194:40645 every 8 connection(s)
I20260806 15:54:24.421721 12813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260806 15:54:24.424355 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 12813
I20260806 15:54:24.424494 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260806 15:54:24.426757 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.195:0
--local_ip_for_outbound_sockets=127.10.189.195
--webserver_interface=127.10.189.195
--webserver_port=0
--tserver_master_addrs=127.10.189.254:44849
--builtin_ntp_servers=127.10.189.212:38363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--inject_latency_ms_before_starting_op=1000 with env {}
I20260806 15:54:24.433676 12950 heartbeater.cc:347] Connected to a master server at 127.10.189.254:44849
I20260806 15:54:24.433936 12950 heartbeater.cc:464] Registering TS with master...
I20260806 15:54:24.434505 12950 heartbeater.cc:511] Master 127.10.189.254:44849 requested a full tablet report, sending...
I20260806 15:54:24.435571 12611 ts_manager.cc:194] Registered new tserver with Master: 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645)
I20260806 15:54:24.436149 12611 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.194:49633
W20260806 15:54:24.539695 12953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:54:24.540017 12953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:54:24.540100 12953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:54:24.544139 12953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:54:24.544294 12953 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.195
I20260806 15:54:24.548947 12953 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:38363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.189.195
--webserver_port=0
--inject_latency_ms_before_starting_op=1000
--tserver_master_addrs=127.10.189.254:44849
--never_fsync=true
--heap_profile_path=/tmp/kudu.12953
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.195
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:54:24.550055 12953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:54:24.551549 12953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:54:24.561362 12958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:54:24.561362 12961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:54:24.561344 12959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:54:24.561398 12953 server_base.cc:1034] running on GCE node
I20260806 15:54:24.562021 12953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:54:24.562705 12953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:54:24.563891 12953 hybrid_clock.cc:648] HybridClock initialized: now 1786031664563863 us; error 45 us; skew 500 ppm
I20260806 15:54:24.565896 12953 webserver.cc:460] Webserver started at http://127.10.189.195:34901/ using document root <none> and password file <none>
I20260806 15:54:24.566586 12953 fs_manager.cc:359] Metadata directory not provided
I20260806 15:54:24.566681 12953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:54:24.566916 12953 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:54:24.568779 12953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "8d6d33b339134d4bad0353e31ec2f0c2"
format_stamp: "Formatted at 2026-08-06 15:54:24 on dist-test-slave-mn4r"
I20260806 15:54:24.569336 12953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "8d6d33b339134d4bad0353e31ec2f0c2"
format_stamp: "Formatted at 2026-08-06 15:54:24 on dist-test-slave-mn4r"
I20260806 15:54:24.572974 12953 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260806 15:54:24.575434 12967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:24.576644 12953 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 15:54:24.576776 12953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "8d6d33b339134d4bad0353e31ec2f0c2"
format_stamp: "Formatted at 2026-08-06 15:54:24 on dist-test-slave-mn4r"
I20260806 15:54:24.576884 12953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:54:24.590672 12953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:54:24.591305 12953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:54:24.591499 12953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:54:24.592067 12953 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:54:24.593007 12953 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:54:24.593078 12953 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:24.593151 12953 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:54:24.593204 12953 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:24.601953 12953 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.195:45291
I20260806 15:54:24.601989 13087 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.195:45291 every 8 connection(s)
I20260806 15:54:24.602895 12953 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260806 15:54:24.604310 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 12953
I20260806 15:54:24.604430 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260806 15:54:24.613816 13088 heartbeater.cc:347] Connected to a master server at 127.10.189.254:44849
I20260806 15:54:24.614115 13088 heartbeater.cc:464] Registering TS with master...
I20260806 15:54:24.614710 13088 heartbeater.cc:511] Master 127.10.189.254:44849 requested a full tablet report, sending...
I20260806 15:54:24.615804 12611 ts_manager.cc:194] Registered new tserver with Master: 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:24.616389 12611 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.195:42729
I20260806 15:54:24.618745 10999 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:54:24.620190 10999 test_util.cc:268] Using random seed: -420650342
I20260806 15:54:24.631362 12611 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43956:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:54:24.632562 12611 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:54:24.649834 13020 tablet_service.cc:1467] Processing CreateTablet for tablet 834c62d563ae453dbee3f2e9478b5fe5 (DEFAULT_TABLE table=test-workload [id=b405d4de67de45a881cd1538cd8cfc11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:54:24.650461 12879 tablet_service.cc:1467] Processing CreateTablet for tablet 834c62d563ae453dbee3f2e9478b5fe5 (DEFAULT_TABLE table=test-workload [id=b405d4de67de45a881cd1538cd8cfc11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:54:24.650467 12737 tablet_service.cc:1467] Processing CreateTablet for tablet 834c62d563ae453dbee3f2e9478b5fe5 (DEFAULT_TABLE table=test-workload [id=b405d4de67de45a881cd1538cd8cfc11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:54:24.650959 13020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 834c62d563ae453dbee3f2e9478b5fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:54:24.651486 12737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 834c62d563ae453dbee3f2e9478b5fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:54:24.651485 12879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 834c62d563ae453dbee3f2e9478b5fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:54:24.658154 13106 tablet_bootstrap.cc:492] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb: Bootstrap starting.
I20260806 15:54:24.658181 13105 tablet_bootstrap.cc:492] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2: Bootstrap starting.
I20260806 15:54:24.658660 13107 tablet_bootstrap.cc:492] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9: Bootstrap starting.
I20260806 15:54:24.660825 13107 tablet_bootstrap.cc:654] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9: Neither blocks nor log segments found. Creating new log.
I20260806 15:54:24.660825 13105 tablet_bootstrap.cc:654] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2: Neither blocks nor log segments found. Creating new log.
I20260806 15:54:24.661716 13105 log.cc:824] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2: Log is configured to *not* fsync() on all Append() calls
I20260806 15:54:24.661717 13107 log.cc:824] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9: Log is configured to *not* fsync() on all Append() calls
I20260806 15:54:24.662901 13106 tablet_bootstrap.cc:654] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb: Neither blocks nor log segments found. Creating new log.
I20260806 15:54:24.663736 13107 tablet_bootstrap.cc:492] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9: No bootstrap required, opened a new log
I20260806 15:54:24.663771 13105 tablet_bootstrap.cc:492] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2: No bootstrap required, opened a new log
I20260806 15:54:24.663798 13106 log.cc:824] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb: Log is configured to *not* fsync() on all Append() calls
I20260806 15:54:24.663954 13105 ts_tablet_manager.cc:1397] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260806 15:54:24.663975 13107 ts_tablet_manager.cc:1397] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260806 15:54:24.665731 13106 tablet_bootstrap.cc:492] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb: No bootstrap required, opened a new log
I20260806 15:54:24.665953 13106 ts_tablet_manager.cc:1397] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260806 15:54:24.667757 13107 raft_consensus.cc:348] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:24.667999 13107 raft_consensus.cc:374] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:54:24.668051 13107 raft_consensus.cc:729] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83af84deafa34359afbc84e4438dc8e9, State: Initialized, Role: FOLLOWER
I20260806 15:54:24.668563 13107 consensus_queue.cc:260] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:24.668565 13105 raft_consensus.cc:348] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:24.668802 13105 raft_consensus.cc:374] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:54:24.668864 13105 raft_consensus.cc:729] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d6d33b339134d4bad0353e31ec2f0c2, State: Initialized, Role: FOLLOWER
I20260806 15:54:24.669332 13105 consensus_queue.cc:260] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:24.669628 13107 ts_tablet_manager.cc:1428] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260806 15:54:24.669847 13111 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:54:24.669991 13111 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:24.670305 13105 ts_tablet_manager.cc:1428] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260806 15:54:24.670403 12950 heartbeater.cc:503] Master 127.10.189.254:44849 was elected leader, sending a full tablet report...
I20260806 15:54:24.670322 13106 raft_consensus.cc:348] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:24.670579 13106 raft_consensus.cc:374] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:54:24.670634 13106 raft_consensus.cc:729] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 769d1af7b1c64960bd428b93f7b92aeb, State: Initialized, Role: FOLLOWER
I20260806 15:54:24.670687 13088 heartbeater.cc:503] Master 127.10.189.254:44849 was elected leader, sending a full tablet report...
I20260806 15:54:24.670768 13115 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:54:24.670897 13115 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:24.671109 13106 consensus_queue.cc:260] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:24.672451 13115 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
W20260806 15:54:24.672659 12951 tablet.cc:2369] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:54:24.673019 13106 ts_tablet_manager.cc:1428] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 15:54:24.673332 12810 heartbeater.cc:503] Master 127.10.189.254:44849 was elected leader, sending a full tablet report...
I20260806 15:54:24.673425 13117 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:54:24.673542 13117 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:24.675550 13111 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:24.679608 12902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:24.679842 12902 raft_consensus.cc:2454] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d6d33b339134d4bad0353e31ec2f0c2 in term 0.
W20260806 15:54:24.680295 12969 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.189.194:40645 timed out after 0.008s (SENT)
I20260806 15:54:24.680910 13117 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
W20260806 15:54:24.683058 12831 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.10.189.193:42313 for RPC RequestConsensusVote timed out after 0.007s (ON_OUTBOUND_QUEUE)
I20260806 15:54:24.683579 12902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:24.683725 12902 raft_consensus.cc:2454] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 769d1af7b1c64960bd428b93f7b92aeb in term 0.
W20260806 15:54:24.684085 12688 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.189.194:40645 timed out after 0.006s (SENT)
I20260806 15:54:24.685036 12759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:24.685096 13040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "83af84deafa34359afbc84e4438dc8e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:24.685256 12759 raft_consensus.cc:2454] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d6d33b339134d4bad0353e31ec2f0c2 in term 0.
I20260806 15:54:24.685303 13040 raft_consensus.cc:2454] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83af84deafa34359afbc84e4438dc8e9 in term 0.
I20260806 15:54:24.685552 12902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:24.685684 12902 raft_consensus.cc:2454] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d6d33b339134d4bad0353e31ec2f0c2 in term 0.
I20260806 15:54:24.685758 12832 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2; no voters:
I20260806 15:54:24.685833 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb, 8d6d33b339134d4bad0353e31ec2f0c2; no voters:
I20260806 15:54:24.686069 13111 raft_consensus.cc:2781] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:54:24.686208 13111 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:54:24.686195 13114 raft_consensus.cc:2781] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:54:24.686256 13111 raft_consensus.cc:3037] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:54:24.686286 13114 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:54:24.686336 13114 raft_consensus.cc:3037] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:54:24.687199 13040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:24.687456 13111 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:24.687456 13114 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:24.687798 13114 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 1 election: Requested vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:24.687798 13111 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [CANDIDATE]: Term 1 election: Requested vote from peers 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:24.687805 12902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:24.688015 12902 raft_consensus.cc:2379] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 769d1af7b1c64960bd428b93f7b92aeb in current term 1: Already voted for candidate 83af84deafa34359afbc84e4438dc8e9 in this term.
I20260806 15:54:24.688145 13040 raft_consensus.cc:2379] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 769d1af7b1c64960bd428b93f7b92aeb in current term 1: Already voted for candidate 8d6d33b339134d4bad0353e31ec2f0c2 in this term.
I20260806 15:54:24.688148 13039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "83af84deafa34359afbc84e4438dc8e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2"
I20260806 15:54:24.688545 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9"
I20260806 15:54:24.688567 12758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "83af84deafa34359afbc84e4438dc8e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb"
I20260806 15:54:24.688594 12759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "83af84deafa34359afbc84e4438dc8e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:24.688697 12900 raft_consensus.cc:2379] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d6d33b339134d4bad0353e31ec2f0c2 in current term 1: Already voted for candidate 83af84deafa34359afbc84e4438dc8e9 in this term.
I20260806 15:54:24.688673 12758 raft_consensus.cc:3037] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:54:24.689488 12692 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:24.689949 12758 raft_consensus.cc:2454] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83af84deafa34359afbc84e4438dc8e9 in term 1.
I20260806 15:54:24.690094 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb"
I20260806 15:54:24.690275 12831 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9; no voters: 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:24.690109 13117 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260806 15:54:24.690482 13111 raft_consensus.cc:2781] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:54:24.690579 13111 raft_consensus.cc:686] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [term 1 LEADER]: Becoming Leader. State: Replica: 83af84deafa34359afbc84e4438dc8e9, State: Running, Role: LEADER
I20260806 15:54:24.690748 12757 raft_consensus.cc:2379] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d6d33b339134d4bad0353e31ec2f0c2 in current term 1: Already voted for candidate 83af84deafa34359afbc84e4438dc8e9 in this term.
I20260806 15:54:24.690913 13111 consensus_queue.cc:237] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:24.691052 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:24.691211 13114 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260806 15:54:24.694063 12611 catalog_manager.cc:5495] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194). New cstate: current_term: 1 leader_uuid: "83af84deafa34359afbc84e4438dc8e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } health_report { overall_health: UNKNOWN } } }
I20260806 15:54:24.694438 13113 consensus_queue.cc:1035] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:54:24.694664 13111 consensus_queue.cc:1035] T 834c62d563ae453dbee3f2e9478b5fe5 P 83af84deafa34359afbc84e4438dc8e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 15:54:24.717999 13132 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260806 15:54:24.718096 13132 fault_injection.cc:44] THIS SERVER MAY CRASH!
W20260806 15:54:24.744400 12757 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260806 15:54:24.744467 12757 fault_injection.cc:44] THIS SERVER MAY CRASH!
W20260806 15:54:24.744400 13039 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260806 15:54:24.744505 13039 fault_injection.cc:44] THIS SERVER MAY CRASH!
W20260806 15:54:24.863282 12716 tablet_service.cc:2970] error setting up scanner 21eb4661a99144d592522785521be093 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.145s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "68d0c4d964c74849aa667356f3acfc3a"
W20260806 15:54:24.864774 12717 tablet_service.cc:2970] error setting up scanner bb3a8d1515ec4cf3b51606ea617e6510 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.147s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "b29b491c67e646539ab40f4a91f547ad"
W20260806 15:54:24.881846 12717 tablet_service.cc:2970] error setting up scanner 7a6d95bb505643e0b609a605109e665c with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.164s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "68d0c4d964c74849aa667356f3acfc3a"
W20260806 15:54:24.884275 12717 tablet_service.cc:2970] error setting up scanner 9df0784cd6274385be2bb974168d5da7 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.166s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "b29b491c67e646539ab40f4a91f547ad"
W20260806 15:54:24.913981 12717 tablet_service.cc:2970] error setting up scanner 1783e3e081164806805d8dd3cdf466f5 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.196s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "68d0c4d964c74849aa667356f3acfc3a"
W20260806 15:54:24.921808 12717 tablet_service.cc:2970] error setting up scanner b553ff2b74a44c2d802397c2e07493f6 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.204s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "b29b491c67e646539ab40f4a91f547ad"
W20260806 15:54:24.959947 12717 tablet_service.cc:2970] error setting up scanner f362e3e5e6444f309f14e318fb8af280 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.242s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "68d0c4d964c74849aa667356f3acfc3a"
W20260806 15:54:24.975656 12717 tablet_service.cc:2970] error setting up scanner 6cedb9ab83f44a47857742efb315d44c with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.258s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "b29b491c67e646539ab40f4a91f547ad"
W20260806 15:54:25.066164 12717 tablet_service.cc:2970] error setting up scanner 20869b02db954f8783aec7d93c79df07 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.348s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "68d0c4d964c74849aa667356f3acfc3a"
W20260806 15:54:25.073460 12717 tablet_service.cc:2970] error setting up scanner e162b94b68af4d1db4a93f992314703d with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.355s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "b29b491c67e646539ab40f4a91f547ad"
I20260806 15:54:25.141758 13117 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:25.141935 13117 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:25.142764 13117 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:25.143289 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:25.143595 13040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:25.144145 12688 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:25.144484 13117 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260806 15:54:25.251322 12717 tablet_service.cc:2970] error setting up scanner 18108337db394264890a597515353ef9 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.107s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "b29b491c67e646539ab40f4a91f547ad"
W20260806 15:54:25.259972 12717 tablet_service.cc:2970] error setting up scanner 37d4b0bbdb1d48c8912514144721ebd1 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.116s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "68d0c4d964c74849aa667356f3acfc3a"
I20260806 15:54:25.285151 13117 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:25.285286 13117 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:25.285806 13117 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:25.286120 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:25.286522 13040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:25.287003 12692 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:25.287180 13117 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:25.548134 13114 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:25.548282 13114 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:25.549180 13114 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:25.549623 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:25.550150 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:25.550588 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
W20260806 15:54:25.573060 12717 tablet_service.cc:2970] error setting up scanner ccadb9112e4748f795ce63223cf6659a with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.286s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "b29b491c67e646539ab40f4a91f547ad"
I20260806 15:54:25.758188 13114 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260806 15:54:25.837638 12717 tablet_service.cc:2970] error setting up scanner 6dedca7b09824cc5ac4b8e027b6dc591 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.551s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "68d0c4d964c74849aa667356f3acfc3a"
I20260806 15:54:26.157042 13114 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:26.157198 13114 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:26.157768 13114 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:26.158197 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:26.158708 12758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:26.158800 13146 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=2, attempt_no=0}) took 1012 ms. Trace:
I20260806 15:54:26.159140 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:26.159431 13114 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:26.158929 13146 rpcz_store.cc:276] 0806 15:54:25.146579 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:25.146639 (+ 60us) service_pool.cc:227] Handling call
0806 15:54:26.158788 (+1012149us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:25.276716 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:25.276822 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:25.276829 (+ 7us) write_op.cc:435] Acquired schema lock
0806 15:54:25.276830 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:25.276906 (+ 76us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:25.276918 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:25.276921 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:25.276961 (+ 40us) tablet.cc:699] Row locks acquired
0806 15:54:25.276962 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:25.277007 (+ 45us) write_op.cc:270] Start()
0806 15:54:26.103147 (+826140us) write_op.cc:276] Timestamp: P: 1786031665276952 usec, L: 0
0806 15:54:26.103150 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:54:26.103335 (+ 185us) log.cc:842] Serialized 354 byte log entry
0806 15:54:26.158020 (+ 54685us) op_driver.cc:444] REPLICATION: finished
0806 15:54:26.158388 (+ 368us) write_op.cc:301] APPLY: starting
0806 15:54:26.158406 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:26.158437 (+ 31us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:26.158455 (+ 18us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:26.158533 (+ 78us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:26.158574 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:26.158578 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:54:26.158643 (+ 65us) log.cc:842] Serialized 22 byte log entry
0806 15:54:26.158702 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:26.158714 (+ 12us) write_op.cc:454] Released schema lock
0806 15:54:26.158720 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":291,"num_ops":1,"prepare.queue_time_us":129595,"prepare.run_cpu_time_us":634,"prepare.run_wall_time_us":826702,"raft.queue_time_us":20,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":190,"replication_time_us":54846,"spinlock_wait_cycles":104064,"thread_start_us":89,"threads_started":1}]]}
W20260806 15:54:26.662968 12717 tablet_service.cc:2970] error setting up scanner 104e8fd2663a44d1945ad5f1afebca8e with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 1.376s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "b29b491c67e646539ab40f4a91f547ad"
I20260806 15:54:26.782132 13145 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:26.782276 13145 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:26.782923 13145 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:26.783286 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:26.783340 13040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:26.783739 12692 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:27.257853 13114 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:27.258013 13114 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:27.258575 13114 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:27.258985 12758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:27.258996 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:27.259456 12969 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:27.259896 13154 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=3, attempt_no=0}) took 1972 ms. Trace:
I20260806 15:54:27.259979 13154 rpcz_store.cc:276] 0806 15:54:25.287414 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:25.287460 (+ 46us) service_pool.cc:227] Handling call
0806 15:54:27.259881 (+1972421us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:26.103459 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:26.103563 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:26.103568 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:54:26.103570 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:26.103671 (+ 101us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:26.103681 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:26.103685 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:26.103733 (+ 48us) tablet.cc:699] Row locks acquired
0806 15:54:26.103736 (+ 3us) write_op.cc:260] PREPARE: finished
0806 15:54:26.103781 (+ 45us) write_op.cc:270] Start()
0806 15:54:26.418926 (+315145us) write_op.cc:276] Timestamp: P: 1786031666103748 usec, L: 0
0806 15:54:26.418929 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:54:26.419106 (+ 177us) log.cc:842] Serialized 354 byte log entry
0806 15:54:27.259065 (+839959us) op_driver.cc:444] REPLICATION: finished
0806 15:54:27.259327 (+ 262us) write_op.cc:301] APPLY: starting
0806 15:54:27.259344 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:27.259374 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:27.259389 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:27.259446 (+ 57us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:27.259479 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:27.259484 (+ 5us) write_op.cc:312] APPLY: finished
0806 15:54:27.259547 (+ 63us) log.cc:842] Serialized 22 byte log entry
0806 15:54:27.259779 (+ 232us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:27.259795 (+ 16us) write_op.cc:454] Released schema lock
0806 15:54:27.259803 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":210,"num_ops":1,"prepare.queue_time_us":815661,"prepare.run_cpu_time_us":681,"prepare.run_wall_time_us":315751,"raft.queue_time_us":50,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":134,"replication_time_us":840115,"spinlock_wait_cycles":12160,"thread_start_us":52,"threads_started":1}]]}
I20260806 15:54:27.651744 13145 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260806 15:54:27.799605 12717 tablet_service.cc:2970] error setting up scanner 7e93cd02860448019076b3ceb86d3503 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: Timed out waiting for ts: P: 1786031666799363 usec, L: 0 to be safe (mode: NON-LEADER). Current safe time: P: 1786031666103748 usec, L: 0 Physical time difference: 0.696s: new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "68d0c4d964c74849aa667356f3acfc3a"
I20260806 15:54:27.799971 12717 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:59724 (request call id 15) took 1001 ms. Trace:
I20260806 15:54:27.800064 12717 rpcz_store.cc:276] 0806 15:54:26.798937 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:26.799009 (+ 72us) service_pool.cc:227] Handling call
0806 15:54:26.799177 (+ 168us) tablet_service.cc:2780] Created scanner 7e93cd02860448019076b3ceb86d3503 for tablet 834c62d563ae453dbee3f2e9478b5fe5, query id is 68d0c4d964c74849aa667356f3acfc3a
0806 15:54:26.799363 (+ 186us) tablet_service.cc:2920] Creating iterator
0806 15:54:26.799386 (+ 23us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:54:27.799580 (+1000194us) tablet_service.cc:2945] Iterator created
0806 15:54:27.799593 (+ 13us) tablet_service.cc:2967] Iterator init: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: Timed out waiting for ts: P: 1786031666799363 usec, L: 0 to be safe (mode: NON-LEADER). Current safe time: P: 1786031666103748 usec, L: 0 Physical time difference: 0.696s
0806 15:54:27.799958 (+ 365us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260806 15:54:28.032689 13114 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:28.034291 13160 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=4, attempt_no=0}) took 1872 ms. Trace:
I20260806 15:54:28.034391 13160 rpcz_store.cc:276] 0806 15:54:26.161398 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:26.161435 (+ 37us) service_pool.cc:227] Handling call
0806 15:54:28.034272 (+1872837us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:26.419247 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:26.419389 (+ 142us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:26.419393 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:54:26.419395 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:26.419521 (+ 126us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:26.419553 (+ 32us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:26.419557 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:26.419610 (+ 53us) tablet.cc:699] Row locks acquired
0806 15:54:26.419612 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:54:26.419691 (+ 79us) write_op.cc:270] Start()
0806 15:54:27.080850 (+661159us) write_op.cc:276] Timestamp: P: 1786031666419628 usec, L: 0
0806 15:54:27.080855 (+ 5us) op_driver.cc:331] REPLICATION: starting
0806 15:54:27.081103 (+ 248us) log.cc:842] Serialized 354 byte log entry
0806 15:54:28.033666 (+952563us) op_driver.cc:444] REPLICATION: finished
0806 15:54:28.033873 (+ 207us) write_op.cc:301] APPLY: starting
0806 15:54:28.033887 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:28.033912 (+ 25us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:28.033927 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:28.033976 (+ 49us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:28.034001 (+ 25us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:28.034004 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:54:28.034125 (+ 121us) log.cc:842] Serialized 22 byte log entry
0806 15:54:28.034186 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:28.034198 (+ 12us) write_op.cc:454] Released schema lock
0806 15:54:28.034203 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":159,"num_ops":1,"prepare.queue_time_us":257497,"prepare.run_cpu_time_us":850,"prepare.run_wall_time_us":661917,"replication_time_us":952788,"thread_start_us":80,"threads_started":1}]]}
I20260806 15:54:28.126233 13114 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:28.126395 13114 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:28.126916 13114 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:28.127348 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:28.127346 12758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:28.127878 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:28.128064 13114 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:28.281354 13145 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:28.281493 13145 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:28.281994 13145 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:28.282485 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:28.282509 13039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:28.283354 12692 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
W20260806 15:54:28.840911 12717 tablet_service.cc:2970] error setting up scanner 28f31561f0074a408e6a7bfc16878796 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.558s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "b29b491c67e646539ab40f4a91f547ad"
W20260806 15:54:29.210492 12717 tablet_service.cc:2970] error setting up scanner 9dbe9e9c6c604c6d887bc50865efd30f with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.928s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "68d0c4d964c74849aa667356f3acfc3a"
I20260806 15:54:29.239842 13145 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:29.326414 13164 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:29.326563 13164 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:29.327083 13164 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:29.327654 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:29.327683 12758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:29.328174 12969 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:29.328330 13164 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:29.328663 13170 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=6, attempt_no=0}) took 1292 ms. Trace:
I20260806 15:54:29.328743 13170 rpcz_store.cc:276] 0806 15:54:28.035722 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:28.035789 (+ 67us) service_pool.cc:227] Handling call
0806 15:54:29.328633 (+1292844us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:28.036207 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:28.036284 (+ 77us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:28.036286 (+ 2us) write_op.cc:435] Acquired schema lock
0806 15:54:28.036287 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:28.036364 (+ 77us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:28.036373 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:28.036376 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:28.036412 (+ 36us) tablet.cc:699] Row locks acquired
0806 15:54:28.036415 (+ 3us) write_op.cc:260] PREPARE: finished
0806 15:54:28.036452 (+ 37us) write_op.cc:270] Start()
0806 15:54:28.931647 (+895195us) write_op.cc:276] Timestamp: P: 1786031668036426 usec, L: 0
0806 15:54:28.931652 (+ 5us) op_driver.cc:331] REPLICATION: starting
0806 15:54:28.931827 (+ 175us) log.cc:842] Serialized 354 byte log entry
0806 15:54:29.327980 (+396153us) op_driver.cc:444] REPLICATION: finished
0806 15:54:29.328223 (+ 243us) write_op.cc:301] APPLY: starting
0806 15:54:29.328237 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:29.328297 (+ 60us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:29.328312 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:29.328377 (+ 65us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:29.328408 (+ 31us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:29.328412 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:54:29.328475 (+ 63us) log.cc:842] Serialized 22 byte log entry
0806 15:54:29.328534 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:29.328547 (+ 13us) write_op.cc:454] Released schema lock
0806 15:54:29.328552 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":196,"num_ops":1,"prepare.queue_time_us":28,"prepare.run_cpu_time_us":615,"prepare.run_wall_time_us":895706,"replication_time_us":396304,"thread_start_us":82,"threads_started":1}]]}
I20260806 15:54:30.010478 13164 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:30.010632 13164 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:30.011219 13164 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:30.011660 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:30.011703 12758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:30.012217 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:30.012523 13164 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:30.012938 13176 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=7, attempt_no=0}) took 1884 ms. Trace:
I20260806 15:54:30.013059 13176 rpcz_store.cc:276] 0806 15:54:28.128871 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:28.128934 (+ 63us) service_pool.cc:227] Handling call
0806 15:54:30.012924 (+1883990us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:28.931943 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:28.932050 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:28.932055 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:54:28.932057 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:28.932138 (+ 81us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:28.932147 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:28.932150 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:28.932197 (+ 47us) tablet.cc:699] Row locks acquired
0806 15:54:28.932199 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:54:28.932238 (+ 39us) write_op.cc:270] Start()
0806 15:54:29.204385 (+272147us) write_op.cc:276] Timestamp: P: 1786031668932171 usec, L: 0
0806 15:54:29.204389 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:54:29.204739 (+ 350us) log.cc:842] Serialized 354 byte log entry
0806 15:54:30.011846 (+807107us) op_driver.cc:444] REPLICATION: finished
0806 15:54:30.012331 (+ 485us) write_op.cc:301] APPLY: starting
0806 15:54:30.012348 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:30.012386 (+ 38us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:30.012400 (+ 14us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:30.012459 (+ 59us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:30.012491 (+ 32us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:30.012495 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:54:30.012558 (+ 63us) log.cc:842] Serialized 22 byte log entry
0806 15:54:30.012841 (+ 283us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:30.012852 (+ 11us) write_op.cc:454] Released schema lock
0806 15:54:30.012857 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":436,"num_ops":1,"prepare.queue_time_us":802699,"prepare.run_cpu_time_us":808,"prepare.run_wall_time_us":272872,"replication_time_us":807436,"thread_start_us":63,"threads_started":1}]]}
I20260806 15:54:30.221697 13145 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:30.221932 13145 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:30.222554 13145 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:30.223061 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:30.223280 13040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:30.224095 12692 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:30.602681 13164 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:30.602799 13164 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:30.603294 13164 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:30.603824 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:30.603820 12758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:30.604451 12969 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:30.604815 13182 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=8, attempt_no=0}) took 1274 ms. Trace:
I20260806 15:54:30.604933 13182 rpcz_store.cc:276] 0806 15:54:29.330062 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:29.330163 (+ 101us) service_pool.cc:227] Handling call
0806 15:54:30.604802 (+1274639us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:29.330567 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:29.330641 (+ 74us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:29.330643 (+ 2us) write_op.cc:435] Acquired schema lock
0806 15:54:29.330644 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:29.330705 (+ 61us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:29.330710 (+ 5us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:29.330712 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:29.330740 (+ 28us) tablet.cc:699] Row locks acquired
0806 15:54:29.330741 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:29.330766 (+ 25us) write_op.cc:270] Start()
0806 15:54:30.170924 (+840158us) write_op.cc:276] Timestamp: P: 1786031669330722 usec, L: 0
0806 15:54:30.170928 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:54:30.171147 (+ 219us) log.cc:842] Serialized 354 byte log entry
0806 15:54:30.604221 (+433074us) op_driver.cc:444] REPLICATION: finished
0806 15:54:30.604475 (+ 254us) write_op.cc:301] APPLY: starting
0806 15:54:30.604490 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:30.604518 (+ 28us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:30.604531 (+ 13us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:30.604584 (+ 53us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:30.604610 (+ 26us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:30.604614 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:54:30.604669 (+ 55us) log.cc:842] Serialized 22 byte log entry
0806 15:54:30.604729 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:30.604741 (+ 12us) write_op.cc:454] Released schema lock
0806 15:54:30.604745 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":214,"num_ops":1,"prepare.queue_time_us":69,"prepare.run_cpu_time_us":580,"prepare.run_wall_time_us":840656,"raft.queue_time_us":39,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":143,"replication_time_us":433275,"spinlock_wait_cycles":47872,"thread_start_us":67,"threads_started":1}]]}
I20260806 15:54:30.996104 13145 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:31.257692 13145 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:31.257858 13145 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:31.258508 13145 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:31.258917 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:31.259189 13040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:31.259829 12688 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:31.260025 13145 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:31.331692 13164 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:31.885938 13145 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:31.886133 13145 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:31.886677 13145 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:31.887109 13040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:31.887097 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:31.887531 12688 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:31.887738 13145 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260806 15:54:32.426890 12717 tablet_service.cc:2970] error setting up scanner ff2d06d00cf64b53ba7ff49d4d703007 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.539s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "b29b491c67e646539ab40f4a91f547ad"
W20260806 15:54:32.540555 12717 tablet_service.cc:2970] error setting up scanner 560d2d99c37940cca4c495f3b9eddbe2 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.652s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "68d0c4d964c74849aa667356f3acfc3a"
I20260806 15:54:32.544032 13145 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:32.544183 13145 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:32.544727 13145 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:32.545153 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:32.545254 13040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:32.545742 12692 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:32.546057 13145 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:32.546391 13200 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=12, attempt_no=0}) took 1285 ms. Trace:
I20260806 15:54:32.546476 13200 rpcz_store.cc:276] 0806 15:54:31.260612 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:31.260686 (+ 74us) service_pool.cc:227] Handling call
0806 15:54:32.546374 (+1285688us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:31.289596 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:31.289703 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:31.289708 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:54:31.289710 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:31.289795 (+ 85us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:31.289808 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:31.289811 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:31.289856 (+ 45us) tablet.cc:699] Row locks acquired
0806 15:54:31.289857 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:31.289901 (+ 44us) write_op.cc:270] Start()
0806 15:54:31.321048 (+ 31147us) write_op.cc:276] Timestamp: P: 1786031671289852 usec, L: 0
0806 15:54:31.321052 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:54:31.321287 (+ 235us) log.cc:842] Serialized 354 byte log entry
0806 15:54:32.545502 (+1224215us) op_driver.cc:444] REPLICATION: finished
0806 15:54:32.545952 (+ 450us) write_op.cc:301] APPLY: starting
0806 15:54:32.545971 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:32.546003 (+ 32us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:32.546020 (+ 17us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:32.546110 (+ 90us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:32.546144 (+ 34us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:32.546149 (+ 5us) write_op.cc:312] APPLY: finished
0806 15:54:32.546227 (+ 78us) log.cc:842] Serialized 22 byte log entry
0806 15:54:32.546283 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:32.546296 (+ 13us) write_op.cc:454] Released schema lock
0806 15:54:32.546301 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":389,"num_ops":1,"prepare.queue_time_us":28528,"prepare.run_cpu_time_us":689,"prepare.run_wall_time_us":31753,"replication_time_us":1224245,"thread_start_us":207,"threads_started":1}]]}
I20260806 15:54:32.779357 13164 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:32.779491 13164 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:32.779670 13039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.189.194:37147 (request call id 886) took 1446 ms. Trace:
I20260806 15:54:32.779984 13164 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:32.780499 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:32.780840 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:32.779770 13039 rpcz_store.cc:276] 0806 15:54:31.332855 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:31.332922 (+ 67us) service_pool.cc:227] Handling call
0806 15:54:31.333082 (+ 160us) raft_consensus.cc:1457] Updating replica for 3 ops
0806 15:54:31.333158 (+ 76us) raft_consensus.cc:1520] Early marking committed up to index 11
0806 15:54:31.333311 (+ 153us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0806 15:54:31.333421 (+ 110us) write_op.cc:270] Start()
0806 15:54:32.021558 (+688137us) write_op.cc:276] Timestamp: P: 1786031670607424 usec, L: 0
0806 15:54:32.021976 (+ 418us) write_op.cc:270] Start()
0806 15:54:32.405104 (+383128us) write_op.cc:276] Timestamp: P: 1786031670999122 usec, L: 0
0806 15:54:32.405410 (+ 306us) write_op.cc:270] Start()
0806 15:54:32.778582 (+373172us) write_op.cc:276] Timestamp: P: 1786031671289852 usec, L: 0
0806 15:54:32.778975 (+ 393us) log.cc:842] Serialized 1062 byte log entry
0806 15:54:32.779153 (+ 178us) raft_consensus.cc:1631] Marking committed up to 12
0806 15:54:32.779288 (+ 135us) raft_consensus.cc:1683] Filling consensus response to leader.
0806 15:54:32.779315 (+ 27us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0806 15:54:32.779596 (+ 281us) raft_consensus.cc:1671] finished
0806 15:54:32.779598 (+ 2us) raft_consensus.cc:1677] UpdateReplicas() finished
0806 15:54:32.779652 (+ 54us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:32.021876 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:32.022010 (+ 134us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:32.022015 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:54:32.022019 (+ 4us) tablet.cc:660] Decoding operations
0806 15:54:32.022148 (+ 129us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:32.022157 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:32.022159 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:32.022196 (+ 37us) tablet.cc:699] Row locks acquired
0806 15:54:32.022196 (+ 0us) write_op.cc:260] PREPARE: finished
0806 15:54:32.779183 (+756987us) op_driver.cc:444] REPLICATION: finished
0806 15:54:32.779386 (+ 203us) write_op.cc:301] APPLY: starting
0806 15:54:32.779400 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:32.779430 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:32.779431 (+ 1us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:32.779483 (+ 52us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:32.779516 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:32.779534 (+ 18us) write_op.cc:312] APPLY: finished
0806 15:54:32.779605 (+ 71us) log.cc:842] Serialized 22 byte log entry
0806 15:54:32.779693 (+ 88us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:32.779707 (+ 14us) write_op.cc:454] Released schema lock
0806 15:54:32.779714 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0806 15:54:32.779774 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:32.779776 (+ 2us) write_op.cc:454] Released schema lock
Related trace 'op':
0806 15:54:32.405361 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:32.405460 (+ 99us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:32.405464 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:54:32.405466 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:32.405536 (+ 70us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:32.405572 (+ 36us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:32.405575 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:32.405613 (+ 38us) tablet.cc:699] Row locks acquired
0806 15:54:32.405614 (+ 1us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0806 15:54:32.778793 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:32.778925 (+ 132us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:32.778930 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:54:32.778932 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:32.779022 (+ 90us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:32.779033 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:32.779035 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:32.779082 (+ 47us) tablet.cc:699] Row locks acquired
0806 15:54:32.779083 (+ 1us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":115,"threads_started":1,"wal-append.queue_time_us":189,"child_traces":[["op",{"apply.queue_time_us":153,"apply.run_cpu_time_us":430,"apply.run_wall_time_us":430,"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":191,"prepare.run_cpu_time_us":387,"prepare.run_wall_time_us":388,"replication_time_us":1445749,"thread_start_us":142,"threads_started":2}],["op",{"num_ops":1,"partition_lock_wait_us":31,"prepare.queue_time_us":57,"prepare.run_cpu_time_us":334,"prepare.run_wall_time_us":335}],["op",{"num_ops":1,"partition_lock_wait_us":4,"prepare.queue_time_us":58,"prepare.run_cpu_time_us":345,"prepare.run_wall_time_us":346}]]}
I20260806 15:54:32.781235 12969 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:32.781409 13164 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:32.965304 13164 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:32.965461 13164 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:32.966058 13164 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:32.966427 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:32.966583 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:32.967036 13200 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=13, attempt_no=0}) took 1077 ms. Trace:
I20260806 15:54:32.967114 13200 rpcz_store.cc:276] 0806 15:54:31.889126 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:31.889197 (+ 71us) service_pool.cc:227] Handling call
0806 15:54:32.967025 (+1077828us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:31.889677 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:31.889761 (+ 84us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:31.889764 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:54:31.889765 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:31.889821 (+ 56us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:31.889826 (+ 5us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:31.889828 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:31.889854 (+ 26us) tablet.cc:699] Row locks acquired
0806 15:54:31.889855 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:31.889880 (+ 25us) write_op.cc:270] Start()
0806 15:54:32.880065 (+990185us) write_op.cc:276] Timestamp: P: 1786031671889825 usec, L: 0
0806 15:54:32.880069 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:54:32.880251 (+ 182us) log.cc:842] Serialized 354 byte log entry
0806 15:54:32.966577 (+ 86326us) op_driver.cc:444] REPLICATION: finished
0806 15:54:32.966655 (+ 78us) write_op.cc:301] APPLY: starting
0806 15:54:32.966671 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:32.966702 (+ 31us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:32.966716 (+ 14us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:32.966772 (+ 56us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:32.966801 (+ 29us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:32.966807 (+ 6us) write_op.cc:312] APPLY: finished
0806 15:54:32.966881 (+ 74us) log.cc:842] Serialized 22 byte log entry
0806 15:54:32.966941 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:32.966952 (+ 11us) write_op.cc:454] Released schema lock
0806 15:54:32.966957 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":35,"num_ops":1,"prepare.queue_time_us":181,"prepare.run_cpu_time_us":613,"prepare.run_wall_time_us":990672,"raft.queue_time_us":42,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":312,"replication_time_us":86477,"spinlock_wait_cycles":121728,"thread_start_us":116,"threads_started":1}]]}
I20260806 15:54:32.967653 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:32.968087 13164 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:33.178215 13145 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:33.178377 13145 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:33.178915 13145 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:33.179235 13040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:33.179395 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:33.179853 12688 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:33.180123 13145 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:33.950757 13209 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:33.950937 13209 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:33.951579 13209 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:33.951915 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:33.952073 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:33.952503 13211 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=14, attempt_no=0}) took 1404 ms. Trace:
I20260806 15:54:33.952674 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:33.952621 13211 rpcz_store.cc:276] 0806 15:54:32.547861 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:32.547904 (+ 43us) service_pool.cc:227] Handling call
0806 15:54:33.952478 (+1404574us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:32.880383 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:32.880489 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:32.880493 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:54:32.880495 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:32.880572 (+ 77us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:32.880583 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:32.880589 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:32.880666 (+ 77us) tablet.cc:699] Row locks acquired
0806 15:54:32.880668 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:54:32.880711 (+ 43us) write_op.cc:270] Start()
0806 15:54:33.516850 (+636139us) write_op.cc:276] Timestamp: P: 1786031672880653 usec, L: 0
0806 15:54:33.516853 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:54:33.517021 (+ 168us) log.cc:842] Serialized 354 byte log entry
0806 15:54:33.951769 (+434748us) op_driver.cc:444] REPLICATION: finished
0806 15:54:33.952016 (+ 247us) write_op.cc:301] APPLY: starting
0806 15:54:33.952032 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:33.952061 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:33.952077 (+ 16us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:33.952233 (+ 156us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:33.952265 (+ 32us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:33.952269 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:54:33.952331 (+ 62us) log.cc:842] Serialized 22 byte log entry
0806 15:54:33.952394 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:33.952407 (+ 13us) write_op.cc:454] Released schema lock
0806 15:54:33.952412 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":201,"num_ops":1,"prepare.queue_time_us":332091,"prepare.run_cpu_time_us":679,"prepare.run_wall_time_us":636735,"raft.queue_time_us":48,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":179,"replication_time_us":434891,"spinlock_wait_cycles":13568,"thread_start_us":80,"threads_started":1}]]}
I20260806 15:54:33.952854 13209 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:34.219094 13145 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:34.219250 13145 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:34.219830 13145 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:34.220185 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:34.220300 13039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:34.220718 12692 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:34.638319 13209 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:34.638486 13209 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:34.639035 13209 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:34.639501 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:34.639549 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:34.640138 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:34.640523 13219 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=15, attempt_no=0}) took 1671 ms. Trace:
I20260806 15:54:34.640650 13219 rpcz_store.cc:276] 0806 15:54:32.968661 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:32.968704 (+ 43us) service_pool.cc:227] Handling call
0806 15:54:34.640508 (+1671804us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:33.517160 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:33.517267 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:33.517271 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:54:33.517273 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:33.517380 (+ 107us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:33.517388 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:33.517390 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:33.517451 (+ 61us) tablet.cc:699] Row locks acquired
0806 15:54:33.517453 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:54:33.517500 (+ 47us) write_op.cc:270] Start()
0806 15:54:34.034646 (+517146us) write_op.cc:276] Timestamp: P: 1786031673517438 usec, L: 0
0806 15:54:34.034649 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:54:34.034810 (+ 161us) log.cc:842] Serialized 354 byte log entry
0806 15:54:34.639811 (+605001us) op_driver.cc:444] REPLICATION: finished
0806 15:54:34.640052 (+ 241us) write_op.cc:301] APPLY: starting
0806 15:54:34.640068 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:34.640101 (+ 33us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:34.640116 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:34.640209 (+ 93us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:34.640243 (+ 34us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:34.640248 (+ 5us) write_op.cc:312] APPLY: finished
0806 15:54:34.640315 (+ 67us) log.cc:842] Serialized 22 byte log entry
0806 15:54:34.640410 (+ 95us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:34.640422 (+ 12us) write_op.cc:454] Released schema lock
0806 15:54:34.640427 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":182,"num_ops":1,"prepare.queue_time_us":548181,"prepare.run_cpu_time_us":689,"prepare.run_wall_time_us":517761,"raft.queue_time_us":66,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":127,"replication_time_us":605142,"spinlock_wait_cycles":5888,"thread_start_us":71,"threads_started":1}]]}
I20260806 15:54:34.948752 13145 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:35.092214 13209 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:35.093954 13219 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=16, attempt_no=0}) took 1139 ms. Trace:
I20260806 15:54:35.094165 13219 rpcz_store.cc:276] 0806 15:54:33.954120 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:33.954170 (+ 50us) service_pool.cc:227] Handling call
0806 15:54:35.093937 (+1139767us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:34.034960 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:34.035069 (+ 109us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:34.035075 (+ 6us) write_op.cc:435] Acquired schema lock
0806 15:54:34.035079 (+ 4us) tablet.cc:660] Decoding operations
0806 15:54:34.035163 (+ 84us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:34.035176 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:34.035180 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:34.035226 (+ 46us) tablet.cc:699] Row locks acquired
0806 15:54:34.035227 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:34.035272 (+ 45us) write_op.cc:270] Start()
0806 15:54:34.511428 (+476156us) write_op.cc:276] Timestamp: P: 1786031674035215 usec, L: 0
0806 15:54:34.511431 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:54:34.511631 (+ 200us) log.cc:842] Serialized 354 byte log entry
0806 15:54:35.093397 (+581766us) op_driver.cc:444] REPLICATION: finished
0806 15:54:35.093507 (+ 110us) write_op.cc:301] APPLY: starting
0806 15:54:35.093527 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:35.093573 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:35.093595 (+ 22us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:35.093664 (+ 69us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:35.093697 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:35.093701 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:54:35.093779 (+ 78us) log.cc:842] Serialized 22 byte log entry
0806 15:54:35.093840 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:35.093853 (+ 13us) write_op.cc:454] Released schema lock
0806 15:54:35.093858 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":62,"num_ops":1,"prepare.queue_time_us":80442,"prepare.run_cpu_time_us":660,"prepare.run_wall_time_us":476730,"replication_time_us":581939}]]}
I20260806 15:54:35.335469 13209 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:35.335634 13209 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:35.336236 13209 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:35.336615 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 19 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:35.336736 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 19 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:35.337235 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:35.337522 13209 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:35.351841 13209 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:35.351948 13209 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:35.352289 13209 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:35.352862 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 19 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:35.354224 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 19 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:35.354722 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:35.354923 13209 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:35.549358 13145 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:35.549520 13145 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:35.550155 13145 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:35.550534 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 18 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:35.550621 13039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 18 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:35.551261 12692 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:35.558671 13209 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:35.558794 13209 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:35.559293 13209 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:35.559684 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 20 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:35.559675 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 20 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:35.560316 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:35.560498 13209 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260806 15:54:36.013420 12716 tablet_service.cc:2970] error setting up scanner de2c033b64c547e5b1c630214c7d3454 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.462s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "b29b491c67e646539ab40f4a91f547ad"
I20260806 15:54:36.390159 13209 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:36.390338 13209 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:36.390892 13209 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:36.391252 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 21 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:36.391467 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 21 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:36.391911 13228 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=19, attempt_no=0}) took 1053 ms. Trace:
I20260806 15:54:36.392061 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:36.392026 13228 rpcz_store.cc:276] 0806 15:54:35.338256 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:35.338315 (+ 59us) service_pool.cc:227] Handling call
0806 15:54:36.391897 (+1053582us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:35.392968 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:35.393105 (+ 137us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:35.393110 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:54:35.393112 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:35.393194 (+ 82us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:35.393203 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:35.393206 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:35.393249 (+ 43us) tablet.cc:699] Row locks acquired
0806 15:54:35.393250 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:35.393289 (+ 39us) write_op.cc:270] Start()
0806 15:54:35.456415 (+ 63126us) write_op.cc:276] Timestamp: P: 1786031675393247 usec, L: 0
0806 15:54:35.456418 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:54:35.456640 (+ 222us) log.cc:842] Serialized 354 byte log entry
0806 15:54:36.391300 (+934660us) op_driver.cc:444] REPLICATION: finished
0806 15:54:36.391513 (+ 213us) write_op.cc:301] APPLY: starting
0806 15:54:36.391541 (+ 28us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:36.391570 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:36.391606 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:36.391665 (+ 59us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:36.391695 (+ 30us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:36.391699 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:54:36.391763 (+ 64us) log.cc:842] Serialized 22 byte log entry
0806 15:54:36.391815 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:36.391826 (+ 11us) write_op.cc:454] Released schema lock
0806 15:54:36.391831 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":159,"num_ops":1,"prepare.queue_time_us":54335,"prepare.run_cpu_time_us":726,"prepare.run_wall_time_us":63734,"replication_time_us":934862,"thread_start_us":76,"threads_started":1}]]}
I20260806 15:54:36.402665 13209 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260806 15:54:36.614951 12717 tablet_service.cc:2970] error setting up scanner 8445cb067c944c18b842ba78b371bd62 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: Timed out waiting for ts: P: 1786031675614704 usec, L: 0 to be safe (mode: NON-LEADER). Current safe time: P: 1786031674035215 usec, L: 0 Physical time difference: 1.579s: new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "68d0c4d964c74849aa667356f3acfc3a"
I20260806 15:54:36.615267 12717 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:59724 (request call id 20) took 1001 ms. Trace:
I20260806 15:54:36.615317 12717 rpcz_store.cc:276] 0806 15:54:35.614256 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:35.614320 (+ 64us) service_pool.cc:227] Handling call
0806 15:54:35.614527 (+ 207us) tablet_service.cc:2780] Created scanner 8445cb067c944c18b842ba78b371bd62 for tablet 834c62d563ae453dbee3f2e9478b5fe5, query id is 68d0c4d964c74849aa667356f3acfc3a
0806 15:54:35.614717 (+ 190us) tablet_service.cc:2920] Creating iterator
0806 15:54:35.614741 (+ 24us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:54:36.614926 (+1000185us) tablet_service.cc:2945] Iterator created
0806 15:54:36.614939 (+ 13us) tablet_service.cc:2967] Iterator init: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: Timed out waiting for ts: P: 1786031675614704 usec, L: 0 to be safe (mode: NON-LEADER). Current safe time: P: 1786031674035215 usec, L: 0 Physical time difference: 1.579s
0806 15:54:36.615257 (+ 318us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260806 15:54:36.786535 13209 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:36.786710 13209 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:36.787253 13209 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:36.787715 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 23 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:36.787744 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 23 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:36.788487 12969 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:36.788661 13209 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:36.984277 13145 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:36.985096 12758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.189.194:39531 (request call id 928) took 1434 ms. Trace:
I20260806 15:54:36.985172 12758 rpcz_store.cc:276] 0806 15:54:35.550677 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:35.550717 (+ 40us) service_pool.cc:227] Handling call
0806 15:54:35.550873 (+ 156us) raft_consensus.cc:1457] Updating replica for 3 ops
0806 15:54:35.550958 (+ 85us) raft_consensus.cc:1520] Early marking committed up to index 18
0806 15:54:35.551106 (+ 148us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0806 15:54:35.551179 (+ 73us) write_op.cc:270] Start()
0806 15:54:35.882360 (+331181us) write_op.cc:276] Timestamp: P: 1786031674642721 usec, L: 0
0806 15:54:35.882680 (+ 320us) write_op.cc:270] Start()
0806 15:54:36.312903 (+430223us) write_op.cc:276] Timestamp: P: 1786031675207469 usec, L: 0
0806 15:54:36.313224 (+ 321us) write_op.cc:270] Start()
0806 15:54:36.983400 (+670176us) write_op.cc:276] Timestamp: P: 1786031675393247 usec, L: 0
0806 15:54:36.983858 (+ 458us) log.cc:842] Serialized 1062 byte log entry
0806 15:54:36.984033 (+ 175us) raft_consensus.cc:1631] Marking committed up to 19
0806 15:54:36.984196 (+ 163us) raft_consensus.cc:1683] Filling consensus response to leader.
0806 15:54:36.984238 (+ 42us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0806 15:54:36.985034 (+ 796us) raft_consensus.cc:1671] finished
0806 15:54:36.985036 (+ 2us) raft_consensus.cc:1677] UpdateReplicas() finished
0806 15:54:36.985082 (+ 46us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:35.882687 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:35.882811 (+ 124us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:35.882816 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:54:35.882818 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:35.882897 (+ 79us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:35.882909 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:35.882911 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:35.882950 (+ 39us) tablet.cc:699] Row locks acquired
0806 15:54:35.882951 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:36.984068 (+1101117us) op_driver.cc:444] REPLICATION: finished
0806 15:54:36.984552 (+ 484us) write_op.cc:301] APPLY: starting
0806 15:54:36.984566 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:36.984593 (+ 27us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:36.984593 (+ 0us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:36.984645 (+ 52us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:36.984667 (+ 22us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:36.984700 (+ 33us) write_op.cc:312] APPLY: finished
0806 15:54:36.984761 (+ 61us) log.cc:842] Serialized 22 byte log entry
0806 15:54:36.984812 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:36.984822 (+ 10us) write_op.cc:454] Released schema lock
0806 15:54:36.984827 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0806 15:54:36.984887 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:36.984889 (+ 2us) write_op.cc:454] Released schema lock
Related trace 'op':
0806 15:54:36.313195 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:36.313331 (+ 136us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:36.313338 (+ 7us) write_op.cc:435] Acquired schema lock
0806 15:54:36.313340 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:36.313429 (+ 89us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:36.313440 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:36.313442 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:36.313479 (+ 37us) tablet.cc:699] Row locks acquired
0806 15:54:36.313480 (+ 1us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0806 15:54:36.983773 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:36.983905 (+ 132us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:36.983912 (+ 7us) write_op.cc:435] Acquired schema lock
0806 15:54:36.983918 (+ 6us) tablet.cc:660] Decoding operations
0806 15:54:36.983989 (+ 71us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:36.983998 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:36.984000 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:36.984034 (+ 34us) tablet.cc:699] Row locks acquired
0806 15:54:36.984035 (+ 1us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":98,"threads_started":1,"wal-append.queue_time_us":718,"child_traces":[["op",{"apply.queue_time_us":427,"apply.run_cpu_time_us":372,"apply.run_wall_time_us":377,"num_ops":1,"partition_lock_wait_us":6,"prepare.queue_time_us":104,"prepare.run_cpu_time_us":359,"prepare.run_wall_time_us":360,"replication_time_us":1432872,"thread_start_us":75,"threads_started":1}],["op",{"num_ops":1,"partition_lock_wait_us":6,"prepare.queue_time_us":79,"prepare.run_cpu_time_us":409,"prepare.run_wall_time_us":410}],["op",{"num_ops":1,"partition_lock_wait_us":4,"prepare.queue_time_us":251,"prepare.run_cpu_time_us":321,"prepare.run_wall_time_us":321,"thread_start_us":84,"threads_started":1}]]}
I20260806 15:54:37.759771 13236 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:37.759943 13236 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:37.760493 13236 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:37.760897 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 24 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:37.760931 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 24 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:37.761317 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:37.761525 13236 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:37.761663 13238 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=22, attempt_no=0}) took 1356 ms. Trace:
I20260806 15:54:37.761751 13238 rpcz_store.cc:276] 0806 15:54:36.404796 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:36.404915 (+ 119us) service_pool.cc:227] Handling call
0806 15:54:37.761643 (+1356728us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:36.594476 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:36.594585 (+ 109us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:36.594592 (+ 7us) write_op.cc:435] Acquired schema lock
0806 15:54:36.594594 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:36.594671 (+ 77us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:36.594681 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:36.594684 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:36.594728 (+ 44us) tablet.cc:699] Row locks acquired
0806 15:54:36.594732 (+ 4us) write_op.cc:260] PREPARE: finished
0806 15:54:36.594782 (+ 50us) write_op.cc:270] Start()
0806 15:54:37.541931 (+947149us) write_op.cc:276] Timestamp: P: 1786031676594727 usec, L: 0
0806 15:54:37.541934 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:54:37.542135 (+ 201us) log.cc:842] Serialized 354 byte log entry
0806 15:54:37.760915 (+218780us) op_driver.cc:444] REPLICATION: finished
0806 15:54:37.761254 (+ 339us) write_op.cc:301] APPLY: starting
0806 15:54:37.761272 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:37.761302 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:37.761316 (+ 14us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:37.761375 (+ 59us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:37.761410 (+ 35us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:37.761418 (+ 8us) write_op.cc:312] APPLY: finished
0806 15:54:37.761486 (+ 68us) log.cc:842] Serialized 22 byte log entry
0806 15:54:37.761558 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:37.761570 (+ 12us) write_op.cc:454] Released schema lock
0806 15:54:37.761575 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":288,"num_ops":1,"prepare.queue_time_us":189263,"prepare.run_cpu_time_us":894,"prepare.run_wall_time_us":947969,"raft.queue_time_us":181,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":218959,"thread_start_us":198,"threads_started":2}]]}
I20260806 15:54:38.158588 13236 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:38.158757 13236 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:38.159296 13236 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:38.159821 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 25 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:38.160037 13238 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=23, attempt_no=0}) took 1370 ms. Trace:
I20260806 15:54:38.160116 13238 rpcz_store.cc:276] 0806 15:54:36.789344 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:36.789411 (+ 67us) service_pool.cc:227] Handling call
0806 15:54:38.160024 (+1370613us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:37.542472 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:37.542575 (+ 103us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:37.542582 (+ 7us) write_op.cc:435] Acquired schema lock
0806 15:54:37.542585 (+ 3us) tablet.cc:660] Decoding operations
0806 15:54:37.542665 (+ 80us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:37.542672 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:37.542674 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:37.542732 (+ 58us) tablet.cc:699] Row locks acquired
0806 15:54:37.542733 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:37.542773 (+ 40us) write_op.cc:270] Start()
0806 15:54:37.679998 (+137225us) write_op.cc:276] Timestamp: P: 1786031677542714 usec, L: 0
0806 15:54:37.680002 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:54:37.680240 (+ 238us) log.cc:842] Serialized 354 byte log entry
0806 15:54:38.159554 (+479314us) op_driver.cc:444] REPLICATION: finished
0806 15:54:38.159629 (+ 75us) write_op.cc:301] APPLY: starting
0806 15:54:38.159648 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:38.159675 (+ 27us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:38.159688 (+ 13us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:38.159745 (+ 57us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:38.159776 (+ 31us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:38.159780 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:54:38.159843 (+ 63us) log.cc:842] Serialized 22 byte log entry
0806 15:54:38.159936 (+ 93us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:38.159948 (+ 12us) write_op.cc:454] Released schema lock
0806 15:54:38.159953 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":26,"num_ops":1,"prepare.queue_time_us":752671,"prepare.run_cpu_time_us":771,"prepare.run_wall_time_us":137853,"replication_time_us":479528}]]}
I20260806 15:54:38.160351 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 25 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:38.160805 12969 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:38.316576 13236 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:38.617020 13145 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:38.617157 13145 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:38.617211 12758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.189.194:39531 (request call id 929) took 1630 ms. Trace:
I20260806 15:54:38.617287 12758 rpcz_store.cc:276] 0806 15:54:36.986817 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:36.986907 (+ 90us) service_pool.cc:227] Handling call
0806 15:54:36.987066 (+ 159us) raft_consensus.cc:1457] Updating replica for 2 ops
0806 15:54:36.987124 (+ 58us) raft_consensus.cc:1520] Early marking committed up to index 21
0806 15:54:36.987331 (+ 207us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0806 15:54:36.987429 (+ 98us) write_op.cc:270] Start()
0806 15:54:37.824586 (+837157us) write_op.cc:276] Timestamp: P: 1786031675561721 usec, L: 0
0806 15:54:37.824942 (+ 356us) write_op.cc:270] Start()
0806 15:54:38.616091 (+791149us) write_op.cc:276] Timestamp: P: 1786031676393968 usec, L: 0
0806 15:54:38.616583 (+ 492us) log.cc:842] Serialized 708 byte log entry
0806 15:54:38.616734 (+ 151us) raft_consensus.cc:1631] Marking committed up to 23
0806 15:54:38.616964 (+ 230us) raft_consensus.cc:1683] Filling consensus response to leader.
0806 15:54:38.616989 (+ 25us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0806 15:54:38.617151 (+ 162us) raft_consensus.cc:1671] finished
0806 15:54:38.617153 (+ 2us) raft_consensus.cc:1677] UpdateReplicas() finished
0806 15:54:38.617195 (+ 42us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:37.824993 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:37.825094 (+ 101us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:37.825097 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:54:37.825099 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:37.825170 (+ 71us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:37.825181 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:37.825183 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:37.825220 (+ 37us) tablet.cc:699] Row locks acquired
0806 15:54:37.825221 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:38.616766 (+791545us) op_driver.cc:444] REPLICATION: finished
0806 15:54:38.616961 (+ 195us) write_op.cc:301] APPLY: starting
0806 15:54:38.616977 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:38.617009 (+ 32us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:38.617011 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:38.617065 (+ 54us) tablet.cc:1381] finished ApplyRowOperation cycle
Related trace 'op':
0806 15:54:38.616463 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:38.616559 (+ 96us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:38.616563 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:54:38.616564 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:38.616630 (+ 66us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:38.616639 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:38.616641 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:38.616676 (+ 35us) tablet.cc:699] Row locks acquired
0806 15:54:38.616677 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:38.616879 (+ 202us) op_driver.cc:444] REPLICATION: finished
0806 15:54:38.617015 (+ 136us) write_op.cc:301] APPLY: starting
0806 15:54:38.617022 (+ 7us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:38.617034 (+ 12us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:38.617035 (+ 1us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:38.617065 (+ 30us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:38.617095 (+ 30us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:38.617112 (+ 17us) write_op.cc:312] APPLY: finished
0806 15:54:38.617169 (+ 57us) log.cc:842] Serialized 22 byte log entry
0806 15:54:38.617214 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:38.617225 (+ 11us) write_op.cc:454] Released schema lock
0806 15:54:38.617231 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0806 15:54:38.617290 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:38.617295 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"thread_start_us":94,"threads_started":1,"wal-append.queue_time_us":169,"child_traces":[["op",{"apply.queue_time_us":137,"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":274,"prepare.run_cpu_time_us":306,"prepare.run_wall_time_us":307,"replication_time_us":1629324,"thread_start_us":142,"threads_started":2}],["op",{"apply.queue_time_us":106,"apply.run_cpu_time_us":314,"apply.run_wall_time_us":314,"num_ops":1,"partition_lock_wait_us":4,"prepare.queue_time_us":234,"prepare.run_cpu_time_us":279,"prepare.run_wall_time_us":279,"replication_time_us":791929,"thread_start_us":165,"threads_started":2}]]}
I20260806 15:54:38.617633 13145 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:38.617939 13040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 23 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:38.618312 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 23 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:38.618813 12688 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
W20260806 15:54:39.177416 12717 tablet_service.cc:2970] error setting up scanner a2fdbb0f540f46bea76564fe4b309b15 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.561s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "68d0c4d964c74849aa667356f3acfc3a"
W20260806 15:54:39.599431 12717 tablet_service.cc:2970] error setting up scanner 601201d4da164efc80727f275593e756 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.983s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "b29b491c67e646539ab40f4a91f547ad"
I20260806 15:54:39.913192 13245 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:39.913347 13245 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:39.914184 13245 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:39.914594 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 27 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:39.914780 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 27 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:39.915264 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:39.915699 13251 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=25, attempt_no=0}) took 1754 ms. Trace:
I20260806 15:54:39.915755 13251 rpcz_store.cc:276] 0806 15:54:38.161361 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:38.161430 (+ 69us) service_pool.cc:227] Handling call
0806 15:54:39.915686 (+1754256us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:38.161848 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:38.161931 (+ 83us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:38.161935 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:54:38.161936 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:38.161992 (+ 56us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:38.161997 (+ 5us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:38.161999 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:38.162026 (+ 27us) tablet.cc:699] Row locks acquired
0806 15:54:38.162027 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:38.162053 (+ 26us) write_op.cc:270] Start()
0806 15:54:39.046190 (+884137us) write_op.cc:276] Timestamp: P: 1786031678161984 usec, L: 0
0806 15:54:39.046194 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:54:39.046386 (+ 192us) log.cc:842] Serialized 354 byte log entry
0806 15:54:39.914947 (+868561us) op_driver.cc:444] REPLICATION: finished
0806 15:54:39.915315 (+ 368us) write_op.cc:301] APPLY: starting
0806 15:54:39.915333 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:39.915363 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:39.915380 (+ 17us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:39.915438 (+ 58us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:39.915471 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:39.915475 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:54:39.915530 (+ 55us) log.cc:842] Serialized 22 byte log entry
0806 15:54:39.915599 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:39.915613 (+ 14us) write_op.cc:454] Released schema lock
0806 15:54:39.915618 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":311,"num_ops":1,"prepare.queue_time_us":87,"prepare.run_cpu_time_us":557,"prepare.run_wall_time_us":884628,"replication_time_us":868733,"thread_start_us":68,"threads_started":1}]]}
I20260806 15:54:40.389199 13145 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:40.389513 12758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.189.194:39531 (request call id 930) took 1771 ms. Trace:
I20260806 15:54:40.389587 12758 rpcz_store.cc:276] 0806 15:54:38.618534 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:38.618653 (+ 119us) service_pool.cc:227] Handling call
0806 15:54:38.618800 (+ 147us) raft_consensus.cc:1457] Updating replica for 3 ops
0806 15:54:38.618875 (+ 75us) raft_consensus.cc:1520] Early marking committed up to index 0
0806 15:54:38.618877 (+ 2us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0806 15:54:38.618961 (+ 84us) write_op.cc:270] Start()
0806 15:54:39.488129 (+869168us) write_op.cc:276] Timestamp: P: 1786031676594727 usec, L: 0
0806 15:54:39.488478 (+ 349us) write_op.cc:270] Start()
0806 15:54:39.771642 (+283164us) write_op.cc:276] Timestamp: P: 1786031677542714 usec, L: 0
0806 15:54:39.771933 (+ 291us) write_op.cc:270] Start()
0806 15:54:40.388104 (+616171us) write_op.cc:276] Timestamp: P: 1786031677763892 usec, L: 0
0806 15:54:40.388646 (+ 542us) log.cc:842] Serialized 1062 byte log entry
0806 15:54:40.388782 (+ 136us) raft_consensus.cc:1631] Marking committed up to 26
0806 15:54:40.389117 (+ 335us) raft_consensus.cc:1683] Filling consensus response to leader.
0806 15:54:40.389149 (+ 32us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0806 15:54:40.389431 (+ 282us) raft_consensus.cc:1671] finished
0806 15:54:40.389433 (+ 2us) raft_consensus.cc:1677] UpdateReplicas() finished
0806 15:54:40.389496 (+ 63us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:39.488477 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:39.488575 (+ 98us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:39.488578 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:54:39.488580 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:39.488649 (+ 69us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:39.488659 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:39.488661 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:39.488696 (+ 35us) tablet.cc:699] Row locks acquired
0806 15:54:39.488697 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:40.388811 (+900114us) op_driver.cc:444] REPLICATION: finished
0806 15:54:40.388985 (+ 174us) write_op.cc:301] APPLY: starting
0806 15:54:40.389001 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:40.389032 (+ 31us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:40.389033 (+ 1us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:40.389097 (+ 64us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:40.389128 (+ 31us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:40.389154 (+ 26us) write_op.cc:312] APPLY: finished
0806 15:54:40.389210 (+ 56us) log.cc:842] Serialized 22 byte log entry
0806 15:54:40.389247 (+ 37us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:40.389257 (+ 10us) write_op.cc:454] Released schema lock
0806 15:54:40.389265 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0806 15:54:40.389323 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:40.389326 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0806 15:54:39.771855 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:39.771958 (+ 103us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:39.771962 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:54:39.771963 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:39.772035 (+ 72us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:39.772044 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:39.772046 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:39.772098 (+ 52us) tablet.cc:699] Row locks acquired
0806 15:54:39.772098 (+ 0us) write_op.cc:260] PREPARE: finished
0806 15:54:40.388923 (+616825us) op_driver.cc:444] REPLICATION: finished
0806 15:54:40.389191 (+ 268us) write_op.cc:301] APPLY: starting
0806 15:54:40.389202 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:40.389224 (+ 22us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:40.389228 (+ 4us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:40.389282 (+ 54us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:40.389307 (+ 25us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:40.389326 (+ 19us) write_op.cc:312] APPLY: finished
0806 15:54:40.389386 (+ 60us) log.cc:842] Serialized 22 byte log entry
0806 15:54:40.389442 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:40.389451 (+ 9us) write_op.cc:454] Released schema lock
0806 15:54:40.389455 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0806 15:54:40.389504 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:40.389506 (+ 2us) write_op.cc:454] Released schema lock
Related trace 'op':
0806 15:54:40.388541 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:40.388651 (+ 110us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:40.388656 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:54:40.388658 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:40.388748 (+ 90us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:40.388760 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:40.388762 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:40.388808 (+ 46us) tablet.cc:699] Row locks acquired
0806 15:54:40.388809 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:40.388999 (+ 190us) op_driver.cc:444] REPLICATION: finished
0806 15:54:40.389387 (+ 388us) write_op.cc:301] APPLY: starting
0806 15:54:40.389398 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:40.389417 (+ 19us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:40.389419 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:40.389455 (+ 36us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:40.389478 (+ 23us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:40.389590 (+ 112us) write_op.cc:312] APPLY: finished
0806 15:54:40.389640 (+ 50us) log.cc:842] Serialized 22 byte log entry
0806 15:54:40.389678 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:40.389685 (+ 7us) write_op.cc:454] Released schema lock
0806 15:54:40.389688 (+ 3us) write_op.cc:341] FINISH: Updating metrics
0806 15:54:40.389723 (+ 35us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:40.389725 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"thread_start_us":81,"threads_started":1,"wal-append.queue_time_us":189,"child_traces":[["op",{"apply.queue_time_us":125,"apply.run_cpu_time_us":385,"apply.run_wall_time_us":385,"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":215,"prepare.run_cpu_time_us":292,"prepare.run_wall_time_us":292,"replication_time_us":1769838,"thread_start_us":138,"threads_started":2}],["op",{"apply.queue_time_us":231,"apply.run_cpu_time_us":349,"apply.run_wall_time_us":349,"num_ops":1,"partition_lock_wait_us":4,"prepare.queue_time_us":64,"prepare.run_cpu_time_us":325,"prepare.run_wall_time_us":326,"replication_time_us":900437,"thread_start_us":43,"threads_started":1}],["op",{"apply.queue_time_us":363,"apply.run_cpu_time_us":290,"apply.run_wall_time_us":365,"num_ops":1,"partition_lock_wait_us":6,"prepare.queue_time_us":308,"prepare.run_cpu_time_us":331,"prepare.run_wall_time_us":331,"replication_time_us":617062,"thread_start_us":196,"threads_started":2}]]}
I20260806 15:54:40.516368 13245 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:40.518203 13261 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=26, attempt_no=0}) took 2199 ms. Trace:
I20260806 15:54:40.518306 13261 rpcz_store.cc:276] 0806 15:54:38.319126 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:38.319187 (+ 61us) service_pool.cc:227] Handling call
0806 15:54:40.518185 (+2198998us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:39.046505 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:39.046626 (+ 121us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:39.046630 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:54:39.046631 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:39.046731 (+ 100us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:39.046742 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:39.046749 (+ 7us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:39.046785 (+ 36us) tablet.cc:699] Row locks acquired
0806 15:54:39.046786 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:39.046820 (+ 34us) write_op.cc:270] Start()
0806 15:54:39.272973 (+226153us) write_op.cc:276] Timestamp: P: 1786031679046766 usec, L: 0
0806 15:54:39.272977 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:54:39.273185 (+ 208us) log.cc:842] Serialized 354 byte log entry
0806 15:54:40.517462 (+1244277us) op_driver.cc:444] REPLICATION: finished
0806 15:54:40.517689 (+ 227us) write_op.cc:301] APPLY: starting
0806 15:54:40.517706 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:40.517741 (+ 35us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:40.517761 (+ 20us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:40.517867 (+ 106us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:40.517899 (+ 32us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:40.517903 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:54:40.517971 (+ 68us) log.cc:842] Serialized 22 byte log entry
0806 15:54:40.518045 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:40.518070 (+ 25us) write_op.cc:454] Released schema lock
0806 15:54:40.518103 (+ 33us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":159,"num_ops":1,"prepare.queue_time_us":727006,"prepare.run_cpu_time_us":697,"prepare.run_wall_time_us":226763,"replication_time_us":1244460,"thread_start_us":77,"threads_started":1}]]}
I20260806 15:54:40.886952 13145 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:40.887126 13145 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:40.887758 13145 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:40.888118 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:40.888475 13040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:40.888947 12688 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:41.283011 13145 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:41.284615 13266 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=27, attempt_no=0}) took 1367 ms. Trace:
I20260806 15:54:41.284711 13266 rpcz_store.cc:276] 0806 15:54:39.916947 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:39.917010 (+ 63us) service_pool.cc:227] Handling call
0806 15:54:41.284598 (+1367588us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:39.917509 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:39.917581 (+ 72us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:39.917583 (+ 2us) write_op.cc:435] Acquired schema lock
0806 15:54:39.917584 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:39.917637 (+ 53us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:39.917642 (+ 5us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:39.917643 (+ 1us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:39.917670 (+ 27us) tablet.cc:699] Row locks acquired
0806 15:54:39.917671 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:39.917694 (+ 23us) write_op.cc:270] Start()
0806 15:54:40.830807 (+913113us) write_op.cc:276] Timestamp: P: 1786031679917652 usec, L: 0
0806 15:54:40.830809 (+ 2us) op_driver.cc:331] REPLICATION: starting
0806 15:54:40.830962 (+ 153us) log.cc:842] Serialized 354 byte log entry
0806 15:54:41.284031 (+453069us) op_driver.cc:444] REPLICATION: finished
0806 15:54:41.284212 (+ 181us) write_op.cc:301] APPLY: starting
0806 15:54:41.284229 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:41.284260 (+ 31us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:41.284282 (+ 22us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:41.284342 (+ 60us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:41.284367 (+ 25us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:41.284370 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:54:41.284451 (+ 81us) log.cc:842] Serialized 22 byte log entry
0806 15:54:41.284510 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:41.284520 (+ 10us) write_op.cc:454] Released schema lock
0806 15:54:41.284525 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":127,"num_ops":1,"prepare.queue_time_us":129,"prepare.run_cpu_time_us":496,"prepare.run_wall_time_us":913551,"raft.queue_time_us":38,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":156,"replication_time_us":453200,"thread_start_us":120,"threads_started":2}]]}
I20260806 15:54:41.530655 13245 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:41.530803 13245 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:41.531343 13245 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:41.531778 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 29 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:41.531900 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 29 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:41.532383 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:41.574589 13145 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:41.574770 13145 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:41.575286 13145 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:41.575683 13040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 30 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:41.575667 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 30 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:41.576113 12688 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:41.576584 13266 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=28, attempt_no=0}) took 1057 ms. Trace:
I20260806 15:54:41.576690 13266 rpcz_store.cc:276] 0806 15:54:40.519555 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:40.519597 (+ 42us) service_pool.cc:227] Handling call
0806 15:54:41.576571 (+1056974us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:40.831100 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:40.831187 (+ 87us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:40.831191 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:54:40.831192 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:40.831282 (+ 90us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:40.831290 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:40.831293 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:40.831339 (+ 46us) tablet.cc:699] Row locks acquired
0806 15:54:40.831341 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:54:40.831384 (+ 43us) write_op.cc:270] Start()
0806 15:54:41.081549 (+250165us) write_op.cc:276] Timestamp: P: 1786031680831372 usec, L: 0
0806 15:54:41.081553 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:54:41.081772 (+ 219us) log.cc:842] Serialized 354 byte log entry
0806 15:54:41.575596 (+493824us) op_driver.cc:444] REPLICATION: finished
0806 15:54:41.575694 (+ 98us) write_op.cc:301] APPLY: starting
0806 15:54:41.575713 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:41.575743 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:41.575760 (+ 17us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:41.576264 (+ 504us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:41.576304 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:41.576309 (+ 5us) write_op.cc:312] APPLY: finished
0806 15:54:41.576373 (+ 64us) log.cc:842] Serialized 22 byte log entry
0806 15:54:41.576468 (+ 95us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:41.576479 (+ 11us) write_op.cc:454] Released schema lock
0806 15:54:41.576484 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":54,"num_ops":1,"prepare.queue_time_us":311199,"prepare.run_cpu_time_us":720,"prepare.run_wall_time_us":250786,"replication_time_us":494019}]]}
W20260806 15:54:41.739408 12717 tablet_service.cc:2970] error setting up scanner 0be7d6bfd1384c8b9dc40207c1795547 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.163s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "68d0c4d964c74849aa667356f3acfc3a"
I20260806 15:54:42.410199 13145 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:42.411900 13273 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=29, attempt_no=0}) took 1125 ms. Trace:
I20260806 15:54:42.412019 13273 rpcz_store.cc:276] 0806 15:54:41.286022 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:41.286108 (+ 86us) service_pool.cc:227] Handling call
0806 15:54:42.411887 (+1125779us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:41.286497 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:41.286582 (+ 85us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:41.286584 (+ 2us) write_op.cc:435] Acquired schema lock
0806 15:54:41.286586 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:41.286639 (+ 53us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:41.286644 (+ 5us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:41.286646 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:41.286672 (+ 26us) tablet.cc:699] Row locks acquired
0806 15:54:41.286673 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:41.286697 (+ 24us) write_op.cc:270] Start()
0806 15:54:41.380836 (+ 94139us) write_op.cc:276] Timestamp: P: 1786031681286647 usec, L: 0
0806 15:54:41.380840 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:54:41.381094 (+ 254us) log.cc:842] Serialized 354 byte log entry
0806 15:54:42.411267 (+1030173us) op_driver.cc:444] REPLICATION: finished
0806 15:54:42.411464 (+ 197us) write_op.cc:301] APPLY: starting
0806 15:54:42.411482 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:42.411520 (+ 38us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:42.411535 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:42.411592 (+ 57us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:42.411683 (+ 91us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:42.411689 (+ 6us) write_op.cc:312] APPLY: finished
0806 15:54:42.411764 (+ 75us) log.cc:842] Serialized 22 byte log entry
0806 15:54:42.411815 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:42.411824 (+ 9us) write_op.cc:454] Released schema lock
0806 15:54:42.411828 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":138,"num_ops":1,"prepare.queue_time_us":71,"prepare.run_cpu_time_us":617,"prepare.run_wall_time_us":94681,"replication_time_us":1030407,"thread_start_us":61,"threads_started":1}]]}
I20260806 15:54:42.775046 13145 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:42.775218 13145 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:42.775710 13145 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:42.776180 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 32 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:42.776180 13040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 32 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:42.776722 13273 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=30, attempt_no=0}) took 1198 ms. Trace:
I20260806 15:54:42.776891 12692 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:42.776809 13273 rpcz_store.cc:276] 0806 15:54:41.577914 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:41.577978 (+ 64us) service_pool.cc:227] Handling call
0806 15:54:42.776709 (+1198731us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:41.578404 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:41.578483 (+ 79us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:41.578486 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:54:41.578487 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:41.578537 (+ 50us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:41.578542 (+ 5us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:41.578544 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:41.578571 (+ 27us) tablet.cc:699] Row locks acquired
0806 15:54:41.578572 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:41.578596 (+ 24us) write_op.cc:270] Start()
0806 15:54:42.209804 (+631208us) write_op.cc:276] Timestamp: P: 1786031681578547 usec, L: 0
0806 15:54:42.209809 (+ 5us) op_driver.cc:331] REPLICATION: starting
0806 15:54:42.210072 (+ 263us) log.cc:842] Serialized 354 byte log entry
0806 15:54:42.775989 (+565917us) op_driver.cc:444] REPLICATION: finished
0806 15:54:42.776102 (+ 113us) write_op.cc:301] APPLY: starting
0806 15:54:42.776120 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:42.776149 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:42.776164 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:42.776225 (+ 61us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:42.776258 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:42.776280 (+ 22us) write_op.cc:312] APPLY: finished
0806 15:54:42.776348 (+ 68us) log.cc:842] Serialized 22 byte log entry
0806 15:54:42.776406 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:42.776417 (+ 11us) write_op.cc:454] Released schema lock
0806 15:54:42.776422 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":52,"num_ops":1,"prepare.queue_time_us":46,"prepare.run_cpu_time_us":675,"prepare.run_wall_time_us":631757,"replication_time_us":566156}]]}
I20260806 15:54:42.777063 13145 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:42.939071 13245 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:42.939507 13039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.189.194:37147 (request call id 2449) took 1407 ms. Trace:
I20260806 15:54:42.939576 13039 rpcz_store.cc:276] 0806 15:54:41.532250 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:41.532307 (+ 57us) service_pool.cc:227] Handling call
0806 15:54:41.532483 (+ 176us) raft_consensus.cc:1457] Updating replica for 2 ops
0806 15:54:41.532588 (+ 105us) raft_consensus.cc:1520] Early marking committed up to index 29
0806 15:54:41.532725 (+ 137us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0806 15:54:41.532821 (+ 96us) write_op.cc:270] Start()
0806 15:54:42.523961 (+991140us) write_op.cc:276] Timestamp: P: 1786031680831372 usec, L: 0
0806 15:54:42.524252 (+ 291us) write_op.cc:270] Start()
0806 15:54:42.938388 (+414136us) write_op.cc:276] Timestamp: P: 1786031681286647 usec, L: 0
0806 15:54:42.938785 (+ 397us) log.cc:842] Serialized 708 byte log entry
0806 15:54:42.939002 (+ 217us) raft_consensus.cc:1631] Marking committed up to 29
0806 15:54:42.939010 (+ 8us) raft_consensus.cc:1683] Filling consensus response to leader.
0806 15:54:42.939040 (+ 30us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0806 15:54:42.939447 (+ 407us) raft_consensus.cc:1671] finished
0806 15:54:42.939449 (+ 2us) raft_consensus.cc:1677] UpdateReplicas() finished
0806 15:54:42.939486 (+ 37us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:42.524305 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:42.524395 (+ 90us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:42.524398 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:54:42.524400 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:42.524466 (+ 66us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:42.524494 (+ 28us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:42.524496 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:42.524542 (+ 46us) tablet.cc:699] Row locks acquired
0806 15:54:42.524543 (+ 1us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0806 15:54:42.938640 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:42.938755 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:42.938760 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:54:42.938761 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:42.938828 (+ 67us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:42.938840 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:42.938843 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:42.938886 (+ 43us) tablet.cc:699] Row locks acquired
0806 15:54:42.938887 (+ 1us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":112,"threads_started":1,"wal-append.queue_time_us":191,"child_traces":[["op",{"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":222,"prepare.run_cpu_time_us":304,"prepare.run_wall_time_us":304,"thread_start_us":76,"threads_started":1}],["op",{"num_ops":1,"partition_lock_wait_us":6,"prepare.queue_time_us":106,"prepare.run_cpu_time_us":326,"prepare.run_wall_time_us":325}]]}
W20260806 15:54:43.185714 12717 tablet_service.cc:2970] error setting up scanner 01ce3e263bdf4885b7c426cd2484487b with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.409s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "b29b491c67e646539ab40f4a91f547ad"
I20260806 15:54:43.803241 13145 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:43.803423 13145 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:43.803944 13145 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:43.804358 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 33 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:43.804495 13040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 33 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:43.805012 12692 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:43.805183 13145 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:43.805456 13283 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=31, attempt_no=0}) took 1392 ms. Trace:
I20260806 15:54:43.805537 13283 rpcz_store.cc:276] 0806 15:54:42.413479 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:42.413551 (+ 72us) service_pool.cc:227] Handling call
0806 15:54:43.805443 (+1391892us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:42.414034 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:42.414126 (+ 92us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:42.414129 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:54:42.414130 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:42.414200 (+ 70us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:42.414205 (+ 5us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:42.414207 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:42.414234 (+ 27us) tablet.cc:699] Row locks acquired
0806 15:54:42.414235 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:42.414260 (+ 25us) write_op.cc:270] Start()
0806 15:54:42.981387 (+567127us) write_op.cc:276] Timestamp: P: 1786031682414226 usec, L: 0
0806 15:54:42.981390 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:54:42.981543 (+ 153us) log.cc:842] Serialized 354 byte log entry
0806 15:54:43.804490 (+822947us) op_driver.cc:444] REPLICATION: finished
0806 15:54:43.804919 (+ 429us) write_op.cc:301] APPLY: starting
0806 15:54:43.804933 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:43.804963 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:43.804975 (+ 12us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:43.805025 (+ 50us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:43.805089 (+ 64us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:43.805093 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:54:43.805155 (+ 62us) log.cc:842] Serialized 22 byte log entry
0806 15:54:43.805361 (+ 206us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:43.805371 (+ 10us) write_op.cc:454] Released schema lock
0806 15:54:43.805376 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":376,"num_ops":1,"prepare.queue_time_us":45,"prepare.run_cpu_time_us":510,"prepare.run_wall_time_us":567580,"raft.queue_time_us":39,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":158,"replication_time_us":823075,"thread_start_us":283,"threads_started":1}]]}
I20260806 15:54:43.908106 13245 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:43.908265 13245 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:43.908768 13245 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:43.909305 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 32 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:43.909329 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 32 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:43.910040 12969 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:44.114415 13145 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:44.114622 13145 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:44.115190 13145 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:44.115577 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 34 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:44.115610 13040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 34 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:44.116133 12692 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:44.116339 13283 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=32, attempt_no=0}) took 1338 ms. Trace:
I20260806 15:54:44.116484 13145 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:44.116412 13283 rpcz_store.cc:276] 0806 15:54:42.778157 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:42.778221 (+ 64us) service_pool.cc:227] Handling call
0806 15:54:44.116327 (+1338106us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:42.981639 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:42.981730 (+ 91us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:42.981733 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:54:42.981734 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:42.981822 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:42.981842 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:42.981845 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:42.981892 (+ 47us) tablet.cc:699] Row locks acquired
0806 15:54:42.981895 (+ 3us) write_op.cc:260] PREPARE: finished
0806 15:54:42.981940 (+ 45us) write_op.cc:270] Start()
0806 15:54:43.696132 (+714192us) write_op.cc:276] Timestamp: P: 1786031682981897 usec, L: 0
0806 15:54:43.696135 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:54:43.696350 (+ 215us) log.cc:842] Serialized 354 byte log entry
0806 15:54:44.115591 (+419241us) op_driver.cc:444] REPLICATION: finished
0806 15:54:44.115890 (+ 299us) write_op.cc:301] APPLY: starting
0806 15:54:44.115907 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:44.115939 (+ 32us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:44.115956 (+ 17us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:44.116020 (+ 64us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:44.116052 (+ 32us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:44.116061 (+ 9us) write_op.cc:312] APPLY: finished
0806 15:54:44.116138 (+ 77us) log.cc:842] Serialized 22 byte log entry
0806 15:54:44.116236 (+ 98us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:44.116248 (+ 12us) write_op.cc:454] Released schema lock
0806 15:54:44.116254 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":239,"num_ops":1,"prepare.queue_time_us":203124,"prepare.run_cpu_time_us":667,"prepare.run_wall_time_us":714767,"replication_time_us":419433}]]}
I20260806 15:54:44.778546 13245 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260806 15:54:45.069494 12717 tablet_service.cc:2970] error setting up scanner 19890594fb114597aa0c68f1e1d50bbf with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.953s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "68d0c4d964c74849aa667356f3acfc3a"
I20260806 15:54:45.161782 13245 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:45.162007 13245 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:45.162531 13245 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:45.162896 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:45.163309 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:45.163753 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:45.164152 13294 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=33, attempt_no=0}) took 1357 ms. Trace:
I20260806 15:54:45.164232 13294 rpcz_store.cc:276] 0806 15:54:43.807087 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:43.807143 (+ 56us) service_pool.cc:227] Handling call
0806 15:54:45.164140 (+1356997us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:43.807496 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:43.807567 (+ 71us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:43.807570 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:54:43.807570 (+ 0us) tablet.cc:660] Decoding operations
0806 15:54:43.807643 (+ 73us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:43.807647 (+ 4us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:43.807649 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:43.807674 (+ 25us) tablet.cc:699] Row locks acquired
0806 15:54:43.807675 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:43.807700 (+ 25us) write_op.cc:270] Start()
0806 15:54:44.637840 (+830140us) write_op.cc:276] Timestamp: P: 1786031683807636 usec, L: 0
0806 15:54:44.637844 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:54:44.638060 (+ 216us) log.cc:842] Serialized 354 byte log entry
0806 15:54:45.162995 (+524935us) op_driver.cc:444] REPLICATION: finished
0806 15:54:45.163633 (+ 638us) write_op.cc:301] APPLY: starting
0806 15:54:45.163649 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:45.163678 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:45.163692 (+ 14us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:45.163755 (+ 63us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:45.163787 (+ 32us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:45.163791 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:54:45.163848 (+ 57us) log.cc:842] Serialized 22 byte log entry
0806 15:54:45.164063 (+ 215us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:45.164074 (+ 11us) write_op.cc:454] Released schema lock
0806 15:54:45.164081 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":580,"num_ops":1,"prepare.queue_time_us":43,"prepare.run_cpu_time_us":593,"prepare.run_wall_time_us":830649,"replication_time_us":525128,"thread_start_us":81,"threads_started":1}]]}
I20260806 15:54:45.308490 13288 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:45.308647 13288 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:45.309250 13288 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:45.309713 13040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:45.309724 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:45.310325 12692 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
W20260806 15:54:45.747668 12717 tablet_service.cc:2970] error setting up scanner 6031ab0e2cf846e1a018eb975a3b7edf with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.437s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "b29b491c67e646539ab40f4a91f547ad"
I20260806 15:54:45.842376 13245 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:45.844100 13301 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=34, attempt_no=0}) took 1726 ms. Trace:
I20260806 15:54:45.844214 13301 rpcz_store.cc:276] 0806 15:54:44.117803 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:44.117914 (+ 111us) service_pool.cc:227] Handling call
0806 15:54:45.844083 (+1726169us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:44.638185 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:44.638308 (+ 123us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:44.638313 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:54:44.638314 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:44.638396 (+ 82us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:44.638407 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:44.638410 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:44.638471 (+ 61us) tablet.cc:699] Row locks acquired
0806 15:54:44.638472 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:44.638511 (+ 39us) write_op.cc:270] Start()
0806 15:54:45.135662 (+497151us) write_op.cc:276] Timestamp: P: 1786031684638453 usec, L: 0
0806 15:54:45.135668 (+ 6us) op_driver.cc:331] REPLICATION: starting
0806 15:54:45.135952 (+ 284us) log.cc:842] Serialized 354 byte log entry
0806 15:54:45.843511 (+707559us) op_driver.cc:444] REPLICATION: finished
0806 15:54:45.843714 (+ 203us) write_op.cc:301] APPLY: starting
0806 15:54:45.843729 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:45.843757 (+ 28us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:45.843773 (+ 16us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:45.843828 (+ 55us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:45.843857 (+ 29us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:45.843861 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:54:45.843924 (+ 63us) log.cc:842] Serialized 22 byte log entry
0806 15:54:45.843996 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:45.844008 (+ 12us) write_op.cc:454] Released schema lock
0806 15:54:45.844012 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":148,"num_ops":1,"prepare.queue_time_us":519874,"prepare.run_cpu_time_us":779,"prepare.run_wall_time_us":497833,"replication_time_us":707816,"thread_start_us":63,"threads_started":1}]]}
I20260806 15:54:46.015133 13288 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:46.058156 13245 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:46.058308 13245 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:46.058915 13245 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:46.059417 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 37 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:46.059418 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 37 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:46.060253 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:46.060467 13245 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:46.696728 13288 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:46.696871 13288 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:46.697443 13288 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:46.697728 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 37 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:46.697721 13040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 37 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:46.698180 12688 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:46.698493 13288 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:46.995133 13288 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:46.995292 13288 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:46.995792 13288 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:46.996171 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 38 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:46.996179 13039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 38 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:46.996817 12692 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:46.997015 13288 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:46.997391 13309 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=36, attempt_no=0}) took 1151 ms. Trace:
I20260806 15:54:46.997457 13309 rpcz_store.cc:276] 0806 15:54:45.845648 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:45.845708 (+ 60us) service_pool.cc:227] Handling call
0806 15:54:46.997380 (+1151672us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:45.846169 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:45.846238 (+ 69us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:45.846240 (+ 2us) write_op.cc:435] Acquired schema lock
0806 15:54:45.846241 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:45.846293 (+ 52us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:45.846299 (+ 6us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:45.846300 (+ 1us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:45.846358 (+ 58us) tablet.cc:699] Row locks acquired
0806 15:54:45.846359 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:45.846383 (+ 24us) write_op.cc:270] Start()
0806 15:54:46.766490 (+920107us) write_op.cc:276] Timestamp: P: 1786031685846319 usec, L: 0
0806 15:54:46.766493 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:54:46.766664 (+ 171us) log.cc:842] Serialized 354 byte log entry
0806 15:54:46.996048 (+229384us) op_driver.cc:444] REPLICATION: finished
0806 15:54:46.996778 (+ 730us) write_op.cc:301] APPLY: starting
0806 15:54:46.996796 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:46.996816 (+ 20us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:46.996830 (+ 14us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:46.996878 (+ 48us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:46.996899 (+ 21us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:46.996902 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:54:46.996949 (+ 47us) log.cc:842] Serialized 22 byte log entry
0806 15:54:46.997314 (+ 365us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:46.997323 (+ 9us) write_op.cc:454] Released schema lock
0806 15:54:46.997327 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":237,"num_ops":1,"prepare.queue_time_us":41,"prepare.run_cpu_time_us":559,"prepare.run_wall_time_us":920613,"raft.queue_time_us":298,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":324,"replication_time_us":229531,"spinlock_wait_cycles":13696,"thread_start_us":117,"threads_started":1}]]}
I20260806 15:54:47.308271 13288 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:47.308435 13288 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:47.309047 13288 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:47.309440 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 39 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:47.309522 13039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 39 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:47.309734 13309 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=37, attempt_no=0}) took 1248 ms. Trace:
I20260806 15:54:47.309938 12692 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:47.309830 13309 rpcz_store.cc:276] 0806 15:54:46.060773 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:46.060838 (+ 65us) service_pool.cc:227] Handling call
0806 15:54:47.309718 (+1248880us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:46.766813 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:46.766916 (+ 103us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:46.766920 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:54:46.766922 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:46.767003 (+ 81us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:46.767012 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:46.767015 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:46.767057 (+ 42us) tablet.cc:699] Row locks acquired
0806 15:54:46.767058 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:46.767095 (+ 37us) write_op.cc:270] Start()
0806 15:54:47.112266 (+345171us) write_op.cc:276] Timestamp: P: 1786031686767037 usec, L: 0
0806 15:54:47.112277 (+ 11us) op_driver.cc:331] REPLICATION: starting
0806 15:54:47.112509 (+ 232us) log.cc:842] Serialized 354 byte log entry
0806 15:54:47.309191 (+196682us) op_driver.cc:444] REPLICATION: finished
0806 15:54:47.309286 (+ 95us) write_op.cc:301] APPLY: starting
0806 15:54:47.309302 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:47.309331 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:47.309345 (+ 14us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:47.309401 (+ 56us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:47.309439 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:47.309443 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:54:47.309516 (+ 73us) log.cc:842] Serialized 22 byte log entry
0806 15:54:47.309629 (+ 113us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:47.309640 (+ 11us) write_op.cc:454] Released schema lock
0806 15:54:47.309646 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":51,"num_ops":1,"prepare.queue_time_us":705562,"prepare.run_cpu_time_us":712,"prepare.run_wall_time_us":345768,"replication_time_us":196888}]]}
I20260806 15:54:47.310140 13288 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:47.609413 13288 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:47.609550 13288 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:47.610158 13288 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:47.610672 13039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 40 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:47.610671 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 40 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:47.611191 12692 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:47.611461 13288 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:47.622306 13308 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:47.622432 13308 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:47.622961 13308 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:47.623407 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 38 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:47.623603 12758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 38 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:47.624013 12969 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:48.529049 13314 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:48.529222 13314 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:48.529937 13314 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:48.530263 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:48.530423 13039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:48.530802 12692 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:48.531243 13314 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:48.531174 13316 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=39, attempt_no=0}) took 1219 ms. Trace:
I20260806 15:54:48.531486 13316 rpcz_store.cc:276] 0806 15:54:47.311314 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:47.311422 (+ 108us) service_pool.cc:227] Handling call
0806 15:54:48.531149 (+1219727us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:47.311815 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:47.311915 (+ 100us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:47.311919 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:54:47.311920 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:47.311972 (+ 52us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:47.311978 (+ 6us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:47.311980 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:47.312007 (+ 27us) tablet.cc:699] Row locks acquired
0806 15:54:47.312008 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:47.312035 (+ 27us) write_op.cc:270] Start()
0806 15:54:48.268192 (+956157us) write_op.cc:276] Timestamp: P: 1786031687311977 usec, L: 0
0806 15:54:48.268196 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:54:48.268372 (+ 176us) log.cc:842] Serialized 354 byte log entry
0806 15:54:48.530159 (+261787us) op_driver.cc:444] REPLICATION: finished
0806 15:54:48.530567 (+ 408us) write_op.cc:301] APPLY: starting
0806 15:54:48.530585 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:48.530617 (+ 32us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:48.530634 (+ 17us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:48.530872 (+ 238us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:48.530906 (+ 34us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:48.530911 (+ 5us) write_op.cc:312] APPLY: finished
0806 15:54:48.530983 (+ 72us) log.cc:842] Serialized 22 byte log entry
0806 15:54:48.531055 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:48.531069 (+ 14us) write_op.cc:454] Released schema lock
0806 15:54:48.531075 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":348,"num_ops":1,"prepare.queue_time_us":65,"prepare.run_cpu_time_us":622,"prepare.run_wall_time_us":956706,"raft.queue_time_us":86,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":177,"replication_time_us":261940,"spinlock_wait_cycles":15744,"thread_start_us":69,"threads_started":1}]]}
I20260806 15:54:48.603060 13308 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260806 15:54:48.911664 12717 tablet_service.cc:2970] error setting up scanner 25c84c0e8aae438f8c9f48068e02e677 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.381s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "68d0c4d964c74849aa667356f3acfc3a"
I20260806 15:54:49.064527 13308 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:49.064683 13308 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:49.065291 13308 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:49.065905 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:49.065919 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:49.066380 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:49.249782 13314 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:49.249990 13314 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:49.250572 13314 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:49.250972 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 42 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:49.251118 13039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 42 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:49.251749 12688 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:49.251914 13314 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:49.252130 13323 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=40, attempt_no=0}) took 1639 ms. Trace:
I20260806 15:54:49.252247 13323 rpcz_store.cc:276] 0806 15:54:47.612564 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:47.612622 (+ 58us) service_pool.cc:227] Handling call
0806 15:54:49.252114 (+1639492us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:48.268566 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:48.268694 (+ 128us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:48.268699 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:54:48.268700 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:48.268788 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:48.268802 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:48.268809 (+ 7us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:48.268872 (+ 63us) tablet.cc:699] Row locks acquired
0806 15:54:48.268874 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:54:48.268923 (+ 49us) write_op.cc:270] Start()
0806 15:54:48.847058 (+578135us) write_op.cc:276] Timestamp: P: 1786031688268875 usec, L: 0
0806 15:54:48.847060 (+ 2us) op_driver.cc:331] REPLICATION: starting
0806 15:54:48.847215 (+ 155us) log.cc:842] Serialized 354 byte log entry
0806 15:54:49.250889 (+403674us) op_driver.cc:444] REPLICATION: finished
0806 15:54:49.251361 (+ 472us) write_op.cc:301] APPLY: starting
0806 15:54:49.251379 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:49.251413 (+ 34us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:49.251430 (+ 17us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:49.251491 (+ 61us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:49.251524 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:49.251528 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:54:49.251596 (+ 68us) log.cc:842] Serialized 22 byte log entry
0806 15:54:49.251868 (+ 272us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:49.252026 (+ 158us) write_op.cc:454] Released schema lock
0806 15:54:49.252033 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":417,"num_ops":1,"prepare.queue_time_us":655552,"prepare.run_cpu_time_us":672,"prepare.run_wall_time_us":578742,"raft.queue_time_us":47,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":144,"replication_time_us":403808,"spinlock_wait_cycles":10496,"thread_start_us":41,"threads_started":1}]]}
I20260806 15:54:49.882545 13308 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:50.022586 13326 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:50.022771 13326 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:50.023952 13326 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:50.024235 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:50.024302 13330 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=41, attempt_no=0}) took 1491 ms. Trace:
I20260806 15:54:50.024427 13330 rpcz_store.cc:276] 0806 15:54:48.532862 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:48.532925 (+ 63us) service_pool.cc:227] Handling call
0806 15:54:50.024274 (+1491349us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:48.847345 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:48.847452 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:48.847458 (+ 6us) write_op.cc:435] Acquired schema lock
0806 15:54:48.847460 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:48.847538 (+ 78us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:48.847547 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:48.847550 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:48.847621 (+ 71us) tablet.cc:699] Row locks acquired
0806 15:54:48.847622 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:48.847665 (+ 43us) write_op.cc:270] Start()
0806 15:54:49.844825 (+997160us) write_op.cc:276] Timestamp: P: 1786031688847578 usec, L: 0
0806 15:54:49.844828 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:54:49.845011 (+ 183us) log.cc:842] Serialized 354 byte log entry
0806 15:54:50.023419 (+178408us) op_driver.cc:444] REPLICATION: finished
0806 15:54:50.023749 (+ 330us) write_op.cc:301] APPLY: starting
0806 15:54:50.023764 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:50.023802 (+ 38us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:50.023818 (+ 16us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:50.023884 (+ 66us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:50.023915 (+ 31us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:50.023919 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:54:50.023986 (+ 67us) log.cc:842] Serialized 22 byte log entry
0806 15:54:50.024204 (+ 218us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:50.024214 (+ 10us) write_op.cc:454] Released schema lock
0806 15:54:50.024218 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":252,"num_ops":1,"prepare.queue_time_us":314016,"prepare.run_cpu_time_us":778,"prepare.run_wall_time_us":997855,"raft.queue_time_us":124,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":4,"replication_time_us":178567,"thread_start_us":189,"threads_started":2}]]}
I20260806 15:54:50.024879 13039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:50.025349 12692 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:50.025529 13326 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260806 15:54:50.333731 12717 tablet_service.cc:2970] error setting up scanner 98d9f0cfacff4238983435ec49adbb65 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: Timed out waiting for ts: P: 1786031689333535 usec, L: 0 to be safe (mode: NON-LEADER). Current safe time: P: 1786031688847578 usec, L: 0 Physical time difference: 0.486s: new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "b29b491c67e646539ab40f4a91f547ad"
I20260806 15:54:50.334043 12717 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:59724 (request call id 29) took 1001 ms. Trace:
I20260806 15:54:50.334179 12717 rpcz_store.cc:276] 0806 15:54:49.333016 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:49.333071 (+ 55us) service_pool.cc:227] Handling call
0806 15:54:49.333225 (+ 154us) tablet_service.cc:2780] Created scanner 98d9f0cfacff4238983435ec49adbb65 for tablet 834c62d563ae453dbee3f2e9478b5fe5, query id is b29b491c67e646539ab40f4a91f547ad
0806 15:54:49.333541 (+ 316us) tablet_service.cc:2920] Creating iterator
0806 15:54:49.333570 (+ 29us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:54:50.333710 (+1000140us) tablet_service.cc:2945] Iterator created
0806 15:54:50.333721 (+ 11us) tablet_service.cc:2967] Iterator init: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: Timed out waiting for ts: P: 1786031689333535 usec, L: 0 to be safe (mode: NON-LEADER). Current safe time: P: 1786031688847578 usec, L: 0 Physical time difference: 0.486s
0806 15:54:50.334030 (+ 309us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260806 15:54:50.516000 13308 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:50.516156 13308 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:50.516654 13308 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:50.516993 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:50.517606 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:50.517978 12969 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:50.518185 13308 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:50.879981 13308 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:50.880155 13308 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:50.880831 13308 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:50.881271 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 44 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:50.881356 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 44 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:50.882045 13336 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=42, attempt_no=0}) took 1628 ms. Trace:
I20260806 15:54:50.882093 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:50.882376 13308 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:50.882176 13336 rpcz_store.cc:276] 0806 15:54:49.253642 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:49.253713 (+ 71us) service_pool.cc:227] Handling call
0806 15:54:50.882027 (+1628314us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:49.845227 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:49.845333 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:49.845336 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:54:49.845337 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:49.845401 (+ 64us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:49.845409 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:49.845410 (+ 1us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:49.845448 (+ 38us) tablet.cc:699] Row locks acquired
0806 15:54:49.845449 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:49.845481 (+ 32us) write_op.cc:270] Start()
0806 15:54:50.671651 (+826170us) write_op.cc:276] Timestamp: P: 1786031689845413 usec, L: 0
0806 15:54:50.671655 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:54:50.671860 (+ 205us) log.cc:842] Serialized 354 byte log entry
0806 15:54:50.881040 (+209180us) op_driver.cc:444] REPLICATION: finished
0806 15:54:50.881618 (+ 578us) write_op.cc:301] APPLY: starting
0806 15:54:50.881637 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:50.881667 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:50.881681 (+ 14us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:50.881742 (+ 61us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:50.881774 (+ 32us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:50.881778 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:54:50.881858 (+ 80us) log.cc:842] Serialized 22 byte log entry
0806 15:54:50.881929 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:50.881943 (+ 14us) write_op.cc:454] Released schema lock
0806 15:54:50.881948 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":400,"num_ops":1,"prepare.queue_time_us":591157,"prepare.run_cpu_time_us":676,"prepare.run_wall_time_us":826758,"raft.queue_time_us":130,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":194,"replication_time_us":209359,"spinlock_wait_cycles":768,"thread_start_us":102,"threads_started":1}]]}
I20260806 15:54:51.499722 13334 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:51.499892 13334 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:51.500538 13334 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:51.500936 13039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 44 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:51.500981 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 44 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:51.501466 12688 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:51.501665 13334 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:51.850291 13337 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:51.850523 13337 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:51.851179 13337 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:51.851591 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:51.851636 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:51.852109 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:51.852650 13343 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=43, attempt_no=0}) took 1826 ms. Trace:
I20260806 15:54:51.852751 13343 rpcz_store.cc:276] 0806 15:54:50.026196 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:50.026297 (+ 101us) service_pool.cc:227] Handling call
0806 15:54:51.852637 (+1826340us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:50.672033 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:50.672139 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:50.672144 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:54:50.672146 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:50.672224 (+ 78us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:50.672235 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:50.672241 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:50.672285 (+ 44us) tablet.cc:699] Row locks acquired
0806 15:54:50.672286 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:50.672330 (+ 44us) write_op.cc:270] Start()
0806 15:54:51.427475 (+755145us) write_op.cc:276] Timestamp: P: 1786031690672292 usec, L: 0
0806 15:54:51.427479 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:54:51.427650 (+ 171us) log.cc:842] Serialized 354 byte log entry
0806 15:54:51.851498 (+423848us) op_driver.cc:444] REPLICATION: finished
0806 15:54:51.851746 (+ 248us) write_op.cc:301] APPLY: starting
0806 15:54:51.851763 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:51.851791 (+ 28us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:51.851807 (+ 16us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:51.851867 (+ 60us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:51.851897 (+ 30us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:51.851902 (+ 5us) write_op.cc:312] APPLY: finished
0806 15:54:51.852511 (+ 609us) log.cc:842] Serialized 22 byte log entry
0806 15:54:51.852567 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:51.852577 (+ 10us) write_op.cc:454] Released schema lock
0806 15:54:51.852581 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":191,"num_ops":1,"prepare.queue_time_us":645370,"prepare.run_cpu_time_us":635,"prepare.run_wall_time_us":755711,"raft.queue_time_us":41,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":149,"replication_time_us":423995,"thread_start_us":97,"threads_started":1}]]}
I20260806 15:54:52.336205 13337 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:52.337702 13343 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=44, attempt_no=0}) took 1454 ms. Trace:
I20260806 15:54:52.337874 13343 rpcz_store.cc:276] 0806 15:54:50.883531 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:50.883608 (+ 77us) service_pool.cc:227] Handling call
0806 15:54:52.337685 (+1454077us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:51.427759 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:51.427858 (+ 99us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:51.427862 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:54:51.427864 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:51.427937 (+ 73us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:51.427946 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:51.427948 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:51.427986 (+ 38us) tablet.cc:699] Row locks acquired
0806 15:54:51.427987 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:51.428021 (+ 34us) write_op.cc:270] Start()
0806 15:54:51.516166 (+ 88145us) write_op.cc:276] Timestamp: P: 1786031691427955 usec, L: 0
0806 15:54:51.516169 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:54:51.516353 (+ 184us) log.cc:842] Serialized 354 byte log entry
0806 15:54:52.337027 (+820674us) op_driver.cc:444] REPLICATION: finished
0806 15:54:52.337192 (+ 165us) write_op.cc:301] APPLY: starting
0806 15:54:52.337210 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:52.337269 (+ 59us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:52.337291 (+ 22us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:52.337375 (+ 84us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:52.337406 (+ 31us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:52.337409 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:54:52.337477 (+ 68us) log.cc:842] Serialized 22 byte log entry
0806 15:54:52.337591 (+ 114us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:52.337604 (+ 13us) write_op.cc:454] Released schema lock
0806 15:54:52.337609 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":92,"num_ops":1,"prepare.queue_time_us":543780,"prepare.run_cpu_time_us":580,"prepare.run_wall_time_us":88647,"replication_time_us":820833}]]}
I20260806 15:54:52.391669 13337 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:52.391816 13337 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:52.392329 13337 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:52.392791 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:52.392807 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:52.393337 12969 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:52.393555 13337 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:52.482806 13334 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:52.483007 13334 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:52.483554 13334 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:52.483855 13040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:52.483860 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:52.484293 12688 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:52.484459 13334 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260806 15:54:53.009649 12717 tablet_service.cc:2970] error setting up scanner 236e0b620dde4f48a392dadd01d9b416 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.525s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "68d0c4d964c74849aa667356f3acfc3a"
I20260806 15:54:53.517484 13334 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:53.517643 13334 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:53.517768 12758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.189.194:39531 (request call id 2612) took 1033 ms. Trace:
I20260806 15:54:53.517843 12758 rpcz_store.cc:276] 0806 15:54:52.484375 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:52.484570 (+ 195us) service_pool.cc:227] Handling call
0806 15:54:52.484712 (+ 142us) raft_consensus.cc:1457] Updating replica for 2 ops
0806 15:54:52.484769 (+ 57us) raft_consensus.cc:1520] Early marking committed up to index 45
0806 15:54:52.484895 (+ 126us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0806 15:54:52.485021 (+ 126us) write_op.cc:270] Start()
0806 15:54:53.261176 (+776155us) write_op.cc:276] Timestamp: P: 1786031691427955 usec, L: 0
0806 15:54:53.261554 (+ 378us) write_op.cc:270] Start()
0806 15:54:53.516708 (+255154us) write_op.cc:276] Timestamp: P: 1786031691854656 usec, L: 0
0806 15:54:53.517006 (+ 298us) log.cc:842] Serialized 708 byte log entry
0806 15:54:53.517167 (+ 161us) raft_consensus.cc:1631] Marking committed up to 47
0806 15:54:53.517413 (+ 246us) raft_consensus.cc:1683] Filling consensus response to leader.
0806 15:54:53.517463 (+ 50us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0806 15:54:53.517703 (+ 240us) raft_consensus.cc:1671] finished
0806 15:54:53.517705 (+ 2us) raft_consensus.cc:1677] UpdateReplicas() finished
0806 15:54:53.517751 (+ 46us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:53.261506 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:53.261649 (+ 143us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:53.261653 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:54:53.261654 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:53.261724 (+ 70us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:53.261733 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:53.261735 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:53.261770 (+ 35us) tablet.cc:699] Row locks acquired
0806 15:54:53.261771 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:53.517198 (+255427us) op_driver.cc:444] REPLICATION: finished
0806 15:54:53.517387 (+ 189us) write_op.cc:301] APPLY: starting
0806 15:54:53.517438 (+ 51us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:53.517465 (+ 27us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:53.517466 (+ 1us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:53.517529 (+ 63us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:53.517562 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:53.517587 (+ 25us) write_op.cc:312] APPLY: finished
0806 15:54:53.517644 (+ 57us) log.cc:842] Serialized 22 byte log entry
0806 15:54:53.517687 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:53.517695 (+ 8us) write_op.cc:454] Released schema lock
0806 15:54:53.517700 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0806 15:54:53.517757 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:53.517759 (+ 2us) write_op.cc:454] Released schema lock
Related trace 'op':
0806 15:54:53.516892 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:53.516994 (+ 102us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:53.516998 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:54:53.516999 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:53.517069 (+ 70us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:53.517079 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:53.517081 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:53.517116 (+ 35us) tablet.cc:699] Row locks acquired
0806 15:54:53.517117 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:53.517324 (+ 207us) op_driver.cc:444] REPLICATION: finished
0806 15:54:53.517822 (+ 498us) write_op.cc:301] APPLY: starting
0806 15:54:53.517836 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:53.517860 (+ 24us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:53.517862 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:53.517899 (+ 37us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:53.517920 (+ 21us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:53.517936 (+ 16us) write_op.cc:312] APPLY: finished
Metrics: {"mutex_wait_us":2,"thread_start_us":101,"threads_started":1,"wal-append.queue_time_us":200,"child_traces":[["op",{"apply.queue_time_us":144,"apply.run_cpu_time_us":410,"apply.run_wall_time_us":410,"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":216,"prepare.run_cpu_time_us":327,"prepare.run_wall_time_us":326,"replication_time_us":1032165,"thread_start_us":164,"threads_started":2}],["op",{"apply.queue_time_us":470,"apply.run_cpu_time_us":303,"apply.run_wall_time_us":303,"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":51,"prepare.run_cpu_time_us":300,"prepare.run_wall_time_us":301,"replication_time_us":255759,"thread_start_us":49,"threads_started":1}]]}
I20260806 15:54:53.518194 13334 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:53.518606 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:53.518968 13039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:53.519421 12692 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:53.525321 13351 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:53.525451 13351 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:53.525957 13351 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:53.526297 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 48 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:53.526662 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 48 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:53.527041 13359 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=46, attempt_no=0}) took 1187 ms. Trace:
I20260806 15:54:53.527026 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:53.527194 13351 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:53.527144 13359 rpcz_store.cc:276] 0806 15:54:52.339241 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:52.339313 (+ 72us) service_pool.cc:227] Handling call
0806 15:54:53.527027 (+1187714us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:52.344151 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:52.344258 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:52.344261 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:54:52.344262 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:52.344319 (+ 57us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:52.344326 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:52.344328 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:52.344359 (+ 31us) tablet.cc:699] Row locks acquired
0806 15:54:52.344360 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:52.344388 (+ 28us) write_op.cc:270] Start()
0806 15:54:53.329504 (+985116us) write_op.cc:276] Timestamp: P: 1786031692344324 usec, L: 0
0806 15:54:53.329507 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:54:53.329697 (+ 190us) log.cc:842] Serialized 354 byte log entry
0806 15:54:53.526385 (+196688us) op_driver.cc:444] REPLICATION: finished
0806 15:54:53.526693 (+ 308us) write_op.cc:301] APPLY: starting
0806 15:54:53.526709 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:53.526731 (+ 22us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:53.526746 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:53.526797 (+ 51us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:53.526823 (+ 26us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:53.526827 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:54:53.526882 (+ 55us) log.cc:842] Serialized 22 byte log entry
0806 15:54:53.526948 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:53.526960 (+ 12us) write_op.cc:454] Released schema lock
0806 15:54:53.526966 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":259,"num_ops":1,"prepare.queue_time_us":4473,"prepare.run_cpu_time_us":583,"prepare.run_wall_time_us":985638,"raft.queue_time_us":42,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":151,"replication_time_us":196857,"thread_start_us":75,"threads_started":1}]]}
I20260806 15:54:53.557422 13351 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:53.557602 13351 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:53.558255 13351 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:53.558670 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 49 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:53.558833 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 49 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:53.559226 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:53.559407 13351 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:53.559890 13359 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=47, attempt_no=0}) took 1165 ms. Trace:
I20260806 15:54:53.559957 13359 rpcz_store.cc:276] 0806 15:54:52.394800 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:52.394845 (+ 45us) service_pool.cc:227] Handling call
0806 15:54:53.559878 (+1165033us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:53.329821 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:53.329931 (+ 110us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:53.329938 (+ 7us) write_op.cc:435] Acquired schema lock
0806 15:54:53.329940 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:53.330021 (+ 81us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:53.330032 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:53.330035 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:53.330119 (+ 84us) tablet.cc:699] Row locks acquired
0806 15:54:53.330122 (+ 3us) write_op.cc:260] PREPARE: finished
0806 15:54:53.330169 (+ 47us) write_op.cc:270] Start()
0806 15:54:53.436309 (+106140us) write_op.cc:276] Timestamp: P: 1786031693330130 usec, L: 0
0806 15:54:53.436313 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:54:53.436518 (+ 205us) log.cc:842] Serialized 354 byte log entry
0806 15:54:53.558506 (+121988us) op_driver.cc:444] REPLICATION: finished
0806 15:54:53.558628 (+ 122us) write_op.cc:301] APPLY: starting
0806 15:54:53.558643 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:53.558673 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:53.559132 (+ 459us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:53.559215 (+ 83us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:53.559251 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:53.559256 (+ 5us) write_op.cc:312] APPLY: finished
0806 15:54:53.559587 (+ 331us) log.cc:842] Serialized 22 byte log entry
0806 15:54:53.559661 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:53.559672 (+ 11us) write_op.cc:454] Released schema lock
0806 15:54:53.559678 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":76,"num_ops":1,"prepare.queue_time_us":934661,"prepare.run_cpu_time_us":719,"prepare.run_wall_time_us":106783,"replication_time_us":122173}]]}
I20260806 15:54:53.867568 13351 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:53.867728 13351 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:53.868295 13351 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:53.868666 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 50 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:53.868773 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 50 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:53.869218 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:53.869382 13351 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:54.678176 13362 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:54.678421 13362 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:54.678973 13362 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:54.679409 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 51 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:54.679406 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 51 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:54.680043 12969 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:54.680266 13362 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:54.680473 13366 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=49, attempt_no=0}) took 1119 ms. Trace:
I20260806 15:54:54.680570 13366 rpcz_store.cc:276] 0806 15:54:53.561347 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:53.561415 (+ 68us) service_pool.cc:227] Handling call
0806 15:54:54.680442 (+1119027us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:53.646638 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:53.646758 (+ 120us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:53.646762 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:54:53.646763 (+ 1us) tablet.cc:660] Decoding operations
0806 15:54:53.646845 (+ 82us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:53.646857 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:53.646860 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:53.646952 (+ 92us) tablet.cc:699] Row locks acquired
0806 15:54:53.646954 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:54:53.646996 (+ 42us) write_op.cc:270] Start()
0806 15:54:54.611130 (+964134us) write_op.cc:276] Timestamp: P: 1786031693646966 usec, L: 0
0806 15:54:54.611134 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:54:54.611305 (+ 171us) log.cc:842] Serialized 354 byte log entry
0806 15:54:54.679252 (+ 67947us) op_driver.cc:444] REPLICATION: finished
0806 15:54:54.679942 (+ 690us) write_op.cc:301] APPLY: starting
0806 15:54:54.679959 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:54.679987 (+ 28us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:54.680000 (+ 13us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:54.680167 (+ 167us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:54.680202 (+ 35us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:54.680207 (+ 5us) write_op.cc:312] APPLY: finished
0806 15:54:54.680270 (+ 63us) log.cc:842] Serialized 22 byte log entry
0806 15:54:54.680349 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:54.680361 (+ 12us) write_op.cc:454] Released schema lock
0806 15:54:54.680366 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":636,"num_ops":1,"prepare.queue_time_us":84883,"prepare.run_cpu_time_us":677,"prepare.run_wall_time_us":964744,"raft.queue_time_us":52,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":204,"replication_time_us":68097,"thread_start_us":91,"threads_started":1}]]}
I20260806 15:54:54.836908 13334 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:54.837404 12758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.189.194:39531 (request call id 2613) took 1318 ms. Trace:
I20260806 15:54:54.837492 12758 rpcz_store.cc:276] 0806 15:54:53.519036 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:53.519100 (+ 64us) service_pool.cc:227] Handling call
0806 15:54:53.519263 (+ 163us) raft_consensus.cc:1457] Updating replica for 2 ops
0806 15:54:53.519319 (+ 56us) raft_consensus.cc:1520] Early marking committed up to index 0
0806 15:54:53.519320 (+ 1us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0806 15:54:53.519449 (+ 129us) write_op.cc:270] Start()
0806 15:54:54.067627 (+548178us) write_op.cc:276] Timestamp: P: 1786031692344324 usec, L: 0
0806 15:54:54.068000 (+ 373us) write_op.cc:270] Start()
0806 15:54:54.836176 (+768176us) write_op.cc:276] Timestamp: P: 1786031693330130 usec, L: 0
0806 15:54:54.836709 (+ 533us) log.cc:842] Serialized 708 byte log entry
0806 15:54:54.836836 (+ 127us) raft_consensus.cc:1631] Marking committed up to 47
0806 15:54:54.836841 (+ 5us) raft_consensus.cc:1683] Filling consensus response to leader.
0806 15:54:54.836865 (+ 24us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0806 15:54:54.837342 (+ 477us) raft_consensus.cc:1671] finished
0806 15:54:54.837344 (+ 2us) raft_consensus.cc:1677] UpdateReplicas() finished
0806 15:54:54.837388 (+ 44us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:54.068123 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:54.068243 (+ 120us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:54.068246 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:54:54.068248 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:54.068327 (+ 79us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:54.068336 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:54.068338 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:54.068374 (+ 36us) tablet.cc:699] Row locks acquired
0806 15:54:54.068375 (+ 1us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0806 15:54:54.836568 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:54.836676 (+ 108us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:54.836681 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:54:54.836683 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:54.836840 (+ 157us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:54.836852 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:54.836855 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:54.836903 (+ 48us) tablet.cc:699] Row locks acquired
0806 15:54:54.836904 (+ 1us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":73,"threads_started":1,"wal-append.queue_time_us":157,"child_traces":[["op",{"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":362,"prepare.run_cpu_time_us":320,"prepare.run_wall_time_us":319,"thread_start_us":89,"threads_started":1}],["op",{"num_ops":1,"partition_lock_wait_us":6,"prepare.queue_time_us":236,"prepare.run_cpu_time_us":414,"prepare.run_wall_time_us":414,"thread_start_us":135,"threads_started":1}]]}
W20260806 15:54:55.200198 12717 tablet_service.cc:2970] error setting up scanner a6b2cc6b10064a8b9e9122684cda37c0 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.361s (maximum allowed 0.100s): new_scan_request { tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\334\336\322\323\006\"3\n\005slave\022*\n b405d4de67de45a881cd1538cd8cfc11\020\001\030\001 \001(\001" signature: "<redacted>""\001\313\265\'\262*\320s\377\367\201o\217\253hX\\[\2568\033a\200\270\343\370\216\252\364x\201\202\013[\231?B\333~\261M&3\335X\374\034e\346&\306\375\"R$\300\031\n\205~z\264aP" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "b29b491c67e646539ab40f4a91f547ad"
I20260806 15:54:55.523675 13334 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:55.523820 13334 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:55.524340 13334 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:55.524830 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 51 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:55.524830 13039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 51 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:55.525365 12692 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:55.525561 13334 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:55.561862 13334 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:55.562032 13334 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:55.562623 13334 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:55.563090 13039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 52 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:55.563192 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 52 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:55.563676 12688 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:55.563896 13377 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=50, attempt_no=0}) took 1693 ms. Trace:
I20260806 15:54:55.563966 13334 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:55.563985 13377 rpcz_store.cc:276] 0806 15:54:53.870250 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:53.870295 (+ 45us) service_pool.cc:227] Handling call
0806 15:54:55.563872 (+1693577us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:54.611411 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:54.611545 (+ 134us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:54.611549 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:54:54.611551 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:54.611624 (+ 73us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:54.611633 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:54.611635 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:54.611677 (+ 42us) tablet.cc:699] Row locks acquired
0806 15:54:54.611678 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:54.611712 (+ 34us) write_op.cc:270] Start()
0806 15:54:55.067861 (+456149us) write_op.cc:276] Timestamp: P: 1786031694611684 usec, L: 0
0806 15:54:55.067864 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:54:55.068087 (+ 223us) log.cc:842] Serialized 354 byte log entry
0806 15:54:55.563221 (+495134us) op_driver.cc:444] REPLICATION: finished
0806 15:54:55.563445 (+ 224us) write_op.cc:301] APPLY: starting
0806 15:54:55.563463 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:55.563493 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:55.563505 (+ 12us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:55.563562 (+ 57us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:55.563597 (+ 35us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:55.563602 (+ 5us) write_op.cc:312] APPLY: finished
0806 15:54:55.563666 (+ 64us) log.cc:842] Serialized 22 byte log entry
0806 15:54:55.563726 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:55.563738 (+ 12us) write_op.cc:454] Released schema lock
0806 15:54:55.563744 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":165,"num_ops":1,"prepare.queue_time_us":740792,"prepare.run_cpu_time_us":658,"prepare.run_wall_time_us":456732,"replication_time_us":495332,"thread_start_us":81,"threads_started":1}]]}
I20260806 15:54:55.696837 13362 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:55.697038 13362 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:55.697643 13362 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:55.697973 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 52 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:55.697974 12758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 52 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:55.698496 12969 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:55.698776 13362 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:56.194415 13362 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:56.194588 13362 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:56.195223 13362 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 769d1af7b1c64960bd428b93f7b92aeb (127.10.189.193:42313)
I20260806 15:54:56.195696 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:56.195776 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "769d1af7b1c64960bd428b93f7b92aeb" is_pre_election: true
I20260806 15:54:56.196171 13381 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:49858 (ReqId={client: 7b05a301e2e54fbd9591ef5c2c12cc4b, seq_no=51, attempt_no=0}) took 1514 ms. Trace:
I20260806 15:54:56.196311 12971 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6d33b339134d4bad0353e31ec2f0c2; no voters: 769d1af7b1c64960bd428b93f7b92aeb, 83af84deafa34359afbc84e4438dc8e9
I20260806 15:54:56.196522 13362 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 8d6d33b339134d4bad0353e31ec2f0c2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:56.196291 13381 rpcz_store.cc:276] 0806 15:54:54.682013 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:54:54.682109 (+ 96us) service_pool.cc:227] Handling call
0806 15:54:56.196158 (+1514049us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:54:55.068194 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 834c62d563ae453dbee3f2e9478b5fe5
0806 15:54:55.068308 (+ 114us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:54:55.068312 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:54:55.068314 (+ 2us) tablet.cc:660] Decoding operations
0806 15:54:55.068398 (+ 84us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:54:55.068407 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:54:55.068410 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:54:55.068453 (+ 43us) tablet.cc:699] Row locks acquired
0806 15:54:55.068454 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:54:55.068495 (+ 41us) write_op.cc:270] Start()
0806 15:54:55.787624 (+719129us) write_op.cc:276] Timestamp: P: 1786031695068424 usec, L: 0
0806 15:54:55.787627 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:54:55.787767 (+ 140us) log.cc:842] Serialized 354 byte log entry
0806 15:54:56.195333 (+407566us) op_driver.cc:444] REPLICATION: finished
0806 15:54:56.195748 (+ 415us) write_op.cc:301] APPLY: starting
0806 15:54:56.195765 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0806 15:54:56.195795 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0806 15:54:56.195813 (+ 18us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:54:56.195871 (+ 58us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:54:56.195917 (+ 46us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:54:56.195922 (+ 5us) write_op.cc:312] APPLY: finished
0806 15:54:56.195988 (+ 66us) log.cc:842] Serialized 22 byte log entry
0806 15:54:56.196045 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:54:56.196085 (+ 40us) write_op.cc:454] Released schema lock
0806 15:54:56.196090 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":368,"mutex_wait_us":23,"num_ops":1,"prepare.queue_time_us":385744,"prepare.run_cpu_time_us":648,"prepare.run_wall_time_us":719715,"raft.queue_time_us":69,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":357,"replication_time_us":407682,"spinlock_wait_cycles":36224,"thread_start_us":86,"threads_started":1}]]}
I20260806 15:54:56.539503 13334 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:56.539664 13334 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:56.540266 13334 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:56.540673 13039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:56.540776 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:56.541240 12688 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:56.541460 13334 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260806 15:54:56.858661 13139 scanner-internal.cc:458] Time spent opening tablet: real 32.002s user 0.008s sys 0.000s
W20260806 15:54:58.790001 13138 scanner-internal.cc:458] Time spent opening tablet: real 33.934s user 0.008s sys 0.000s
I20260806 15:54:58.857232 13020 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260806 15:54:58.858208 12737 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260806 15:54:58.867305 12879 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
72282d82fa1e456181cc326922d6f1d0 | 127.10.189.254:44849 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.189.212:38363 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
769d1af7b1c64960bd428b93f7b92aeb | 127.10.189.193:42313 | HEALTHY | <none> | 0 | 0
83af84deafa34359afbc84e4438dc8e9 | 127.10.189.194:40645 | HEALTHY | <none> | 1 | 0
8d6d33b339134d4bad0353e31ec2f0c2 | 127.10.189.195:45291 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
--------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
inject_latency_ms_before_starting_op | 1000 | hidden,advanced | all 3 server(s) checked
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.10.189.193 | experimental | 127.10.189.193:42313
local_ip_for_outbound_sockets | 127.10.189.194 | experimental | 127.10.189.194:40645
local_ip_for_outbound_sockets | 127.10.189.195 | experimental | 127.10.189.195:45291
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.10.189.193:42313
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.10.189.194:40645
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.10.189.195:45291
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.189.212:38363 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260806 15:54:58.893067 10999 log_verifier.cc:126] Checking tablet 834c62d563ae453dbee3f2e9478b5fe5
I20260806 15:54:58.936383 13415 raft_consensus.cc:482] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83af84deafa34359afbc84e4438dc8e9)
I20260806 15:54:58.936615 13415 raft_consensus.cc:504] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83af84deafa34359afbc84e4438dc8e9" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 40645 } } peers { permanent_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 45291 } } peers { permanent_uuid: "769d1af7b1c64960bd428b93f7b92aeb" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42313 } }
I20260806 15:54:58.937361 13415 leader_election.cc:288] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83af84deafa34359afbc84e4438dc8e9 (127.10.189.194:40645), 8d6d33b339134d4bad0353e31ec2f0c2 (127.10.189.195:45291)
I20260806 15:54:58.937636 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "83af84deafa34359afbc84e4438dc8e9" is_pre_election: true
I20260806 15:54:58.938412 13040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "834c62d563ae453dbee3f2e9478b5fe5" candidate_uuid: "769d1af7b1c64960bd428b93f7b92aeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "8d6d33b339134d4bad0353e31ec2f0c2" is_pre_election: true
I20260806 15:54:58.939002 12692 leader_election.cc:302] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 769d1af7b1c64960bd428b93f7b92aeb; no voters: 83af84deafa34359afbc84e4438dc8e9, 8d6d33b339134d4bad0353e31ec2f0c2
I20260806 15:54:58.939241 13415 raft_consensus.cc:2726] T 834c62d563ae453dbee3f2e9478b5fe5 P 769d1af7b1c64960bd428b93f7b92aeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:54:58.939993 10999 log_verifier.cc:177] Verified matching terms for 53 ops in tablet 834c62d563ae453dbee3f2e9478b5fe5
I20260806 15:54:58.961035 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 12673
W20260806 15:54:58.970191 12831 connection.cc:535] client connection to 127.10.189.193:42313 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 15:54:58.970332 12831 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 1 similar messages]
I20260806 15:54:58.970886 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 12813
W20260806 15:54:58.977870 12972 connection.cc:535] server connection from 127.10.189.194:37147 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 15:54:58.978242 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 12953
I20260806 15:54:58.984231 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 12578
2026-08-06T15:54:58Z chronyd exiting
[ OK ] RaftConsensusElectionITest.ChurnyElections (35203 ms)
[ RUN ] RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency
I20260806 15:54:59.009191 10999 test_util.cc:268] Using random seed: -386261341
I20260806 15:54:59.009919 10999 ts_itest-base.cc:112] Starting cluster with:
I20260806 15:54:59.009967 10999 ts_itest-base.cc:113] --------------
I20260806 15:54:59.009979 10999 ts_itest-base.cc:114] 3 tablet servers
I20260806 15:54:59.009990 10999 ts_itest-base.cc:115] 3 replicas per TS
I20260806 15:54:59.010000 10999 ts_itest-base.cc:116] --------------
2026-08-06T15:54:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:54:59Z Disabled control of system clock
I20260806 15:54:59.019344 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:42375
--webserver_interface=127.10.189.254
--webserver_port=0
--builtin_ntp_servers=127.10.189.212:33423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.189.254:42375 with env {}
W20260806 15:54:59.132891 13432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:54:59.133203 13432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:54:59.133284 13432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:54:59.137401 13432 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:54:59.137486 13432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:54:59.137519 13432 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:54:59.137559 13432 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:54:59.142306 13432 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:33423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.189.254:42375
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:42375
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.10.189.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.13432
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:54:59.143391 13432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:54:59.144874 13432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:54:59.154036 13441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:54:59.154040 13439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:54:59.154066 13438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:54:59.154114 13432 server_base.cc:1034] running on GCE node
I20260806 15:54:59.154939 13432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:54:59.156405 13432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:54:59.157575 13432 hybrid_clock.cc:648] HybridClock initialized: now 1786031699157563 us; error 33 us; skew 500 ppm
I20260806 15:54:59.159981 13432 webserver.cc:460] Webserver started at http://127.10.189.254:35769/ using document root <none> and password file <none>
I20260806 15:54:59.160661 13432 fs_manager.cc:359] Metadata directory not provided
I20260806 15:54:59.160727 13432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:54:59.160974 13432 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:54:59.163035 13432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "c729207e25fa4350a5820a4cd9ea3866"
format_stamp: "Formatted at 2026-08-06 15:54:59 on dist-test-slave-mn4r"
I20260806 15:54:59.163590 13432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "c729207e25fa4350a5820a4cd9ea3866"
format_stamp: "Formatted at 2026-08-06 15:54:59 on dist-test-slave-mn4r"
I20260806 15:54:59.167475 13432 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 15:54:59.169935 13447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:59.171324 13432 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 15:54:59.171463 13432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
uuid: "c729207e25fa4350a5820a4cd9ea3866"
format_stamp: "Formatted at 2026-08-06 15:54:59 on dist-test-slave-mn4r"
I20260806 15:54:59.171574 13432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:54:59.193797 13432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:54:59.194623 13432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:54:59.194861 13432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:54:59.202541 13432 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.254:42375
I20260806 15:54:59.202553 13501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.254:42375 every 8 connection(s)
I20260806 15:54:59.203794 13432 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260806 15:54:59.205173 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 13432
I20260806 15:54:59.205276 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260806 15:54:59.208763 13503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:54:59.215355 13503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866: Bootstrap starting.
I20260806 15:54:59.218427 13503 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866: Neither blocks nor log segments found. Creating new log.
I20260806 15:54:59.219369 13503 log.cc:824] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866: Log is configured to *not* fsync() on all Append() calls
I20260806 15:54:59.221586 13503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866: No bootstrap required, opened a new log
I20260806 15:54:59.227022 13503 raft_consensus.cc:348] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c729207e25fa4350a5820a4cd9ea3866" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42375 } }
I20260806 15:54:59.227310 13503 raft_consensus.cc:374] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:54:59.227371 13503 raft_consensus.cc:729] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c729207e25fa4350a5820a4cd9ea3866, State: Initialized, Role: FOLLOWER
I20260806 15:54:59.227854 13503 consensus_queue.cc:260] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c729207e25fa4350a5820a4cd9ea3866" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42375 } }
I20260806 15:54:59.228029 13503 raft_consensus.cc:388] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:54:59.228099 13503 raft_consensus.cc:482] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:54:59.228205 13503 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:54:59.229367 13503 raft_consensus.cc:504] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c729207e25fa4350a5820a4cd9ea3866" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42375 } }
I20260806 15:54:59.229749 13503 leader_election.cc:302] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c729207e25fa4350a5820a4cd9ea3866; no voters:
I20260806 15:54:59.230162 13503 leader_election.cc:288] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:54:59.230252 13508 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:54:59.230490 13508 raft_consensus.cc:686] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866 [term 1 LEADER]: Becoming Leader. State: Replica: c729207e25fa4350a5820a4cd9ea3866, State: Running, Role: LEADER
I20260806 15:54:59.230830 13508 consensus_queue.cc:237] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c729207e25fa4350a5820a4cd9ea3866" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42375 } }
I20260806 15:54:59.231521 13503 sys_catalog.cc:564] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:54:59.232470 13510 sys_catalog.cc:455] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c729207e25fa4350a5820a4cd9ea3866. Latest consensus state: current_term: 1 leader_uuid: "c729207e25fa4350a5820a4cd9ea3866" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c729207e25fa4350a5820a4cd9ea3866" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42375 } } }
I20260806 15:54:59.232604 13510 sys_catalog.cc:458] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866 [sys.catalog]: This master's current role is: LEADER
I20260806 15:54:59.232872 13509 sys_catalog.cc:455] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c729207e25fa4350a5820a4cd9ea3866" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c729207e25fa4350a5820a4cd9ea3866" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42375 } } }
I20260806 15:54:59.232978 13509 sys_catalog.cc:458] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866 [sys.catalog]: This master's current role is: LEADER
I20260806 15:54:59.233134 13517 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:54:59.236260 13517 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:54:59.241775 13517 catalog_manager.cc:1347] Generated new cluster ID: 43f91e689340411ab6140dce58af1672
I20260806 15:54:59.241881 13517 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:54:59.265349 13517 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:54:59.266633 13517 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:54:59.274766 13517 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c729207e25fa4350a5820a4cd9ea3866: Generated new TSK 0
I20260806 15:54:59.275574 13517 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:54:59.285120 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.193:0
--local_ip_for_outbound_sockets=127.10.189.193
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42375
--builtin_ntp_servers=127.10.189.212:33423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--inject_latency_ms_before_starting_op=1000
--consensus_inject_latency_ms_in_notifications=50 with env {}
W20260806 15:54:59.443475 13527 flags.cc:425] Enabled unsafe flag: --consensus_inject_latency_ms_in_notifications=50
W20260806 15:54:59.443763 13527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:54:59.443785 13527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:54:59.443821 13527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:54:59.447851 13527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:54:59.447944 13527 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.193
I20260806 15:54:59.452643 13527 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:33423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_inject_latency_ms_in_notifications=50
--raft_heartbeat_interval_ms=2
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.10.189.193
--webserver_port=0
--inject_latency_ms_before_starting_op=1000
--tserver_master_addrs=127.10.189.254:42375
--never_fsync=true
--heap_profile_path=/tmp/kudu.13527
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.193
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:54:59.453660 13527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:54:59.455040 13527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:54:59.464293 13532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:54:59.464298 13535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:54:59.464548 13533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:54:59.464705 13527 server_base.cc:1034] running on GCE node
I20260806 15:54:59.465121 13527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:54:59.465719 13527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:54:59.466899 13527 hybrid_clock.cc:648] HybridClock initialized: now 1786031699466876 us; error 28 us; skew 500 ppm
I20260806 15:54:59.468982 13527 webserver.cc:460] Webserver started at http://127.10.189.193:37949/ using document root <none> and password file <none>
I20260806 15:54:59.469624 13527 fs_manager.cc:359] Metadata directory not provided
I20260806 15:54:59.469691 13527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:54:59.469957 13527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:54:59.472076 13527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "31b5f45092c144fe97d06a04bed2a7ae"
format_stamp: "Formatted at 2026-08-06 15:54:59 on dist-test-slave-mn4r"
I20260806 15:54:59.472678 13527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "31b5f45092c144fe97d06a04bed2a7ae"
format_stamp: "Formatted at 2026-08-06 15:54:59 on dist-test-slave-mn4r"
I20260806 15:54:59.476733 13527 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 15:54:59.479264 13541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:59.480532 13527 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 15:54:59.480676 13527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "31b5f45092c144fe97d06a04bed2a7ae"
format_stamp: "Formatted at 2026-08-06 15:54:59 on dist-test-slave-mn4r"
I20260806 15:54:59.480784 13527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:54:59.491133 13527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:54:59.491771 13527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:54:59.491956 13527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:54:59.492529 13527 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:54:59.493461 13527 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:54:59.493526 13527 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:59.493595 13527 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:54:59.493634 13527 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:59.502115 13527 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.193:38717
I20260806 15:54:59.502151 13665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.193:38717 every 8 connection(s)
I20260806 15:54:59.503017 13527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260806 15:54:59.513078 13666 heartbeater.cc:347] Connected to a master server at 127.10.189.254:42375
I20260806 15:54:59.513134 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 13527
I20260806 15:54:59.513230 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260806 15:54:59.513330 13666 heartbeater.cc:464] Registering TS with master...
I20260806 15:54:59.513916 13666 heartbeater.cc:511] Master 127.10.189.254:42375 requested a full tablet report, sending...
I20260806 15:54:59.515334 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.194:0
--local_ip_for_outbound_sockets=127.10.189.194
--webserver_interface=127.10.189.194
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42375
--builtin_ntp_servers=127.10.189.212:33423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--inject_latency_ms_before_starting_op=1000
--consensus_inject_latency_ms_in_notifications=50 with env {}
I20260806 15:54:59.515362 13465 ts_manager.cc:194] Registered new tserver with Master: 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717)
I20260806 15:54:59.516489 13465 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.193:57599
W20260806 15:54:59.627480 13669 flags.cc:425] Enabled unsafe flag: --consensus_inject_latency_ms_in_notifications=50
W20260806 15:54:59.627729 13669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:54:59.627748 13669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:54:59.627782 13669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:54:59.631732 13669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:54:59.631817 13669 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.194
I20260806 15:54:59.636489 13669 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:33423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_inject_latency_ms_in_notifications=50
--raft_heartbeat_interval_ms=2
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.10.189.194
--webserver_port=0
--inject_latency_ms_before_starting_op=1000
--tserver_master_addrs=127.10.189.254:42375
--never_fsync=true
--heap_profile_path=/tmp/kudu.13669
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.194
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:54:59.637461 13669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:54:59.638779 13669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:54:59.648052 13674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:54:59.648082 13677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:54:59.648140 13669 server_base.cc:1034] running on GCE node
W20260806 15:54:59.648082 13675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:54:59.648648 13669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:54:59.649263 13669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:54:59.650445 13669 hybrid_clock.cc:648] HybridClock initialized: now 1786031699650428 us; error 27 us; skew 500 ppm
I20260806 15:54:59.652323 13669 webserver.cc:460] Webserver started at http://127.10.189.194:35939/ using document root <none> and password file <none>
I20260806 15:54:59.652930 13669 fs_manager.cc:359] Metadata directory not provided
I20260806 15:54:59.653014 13669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:54:59.653240 13669 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:54:59.655167 13669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "bb3aba5c6068409ea525fe08b90c871f"
format_stamp: "Formatted at 2026-08-06 15:54:59 on dist-test-slave-mn4r"
I20260806 15:54:59.655714 13669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "bb3aba5c6068409ea525fe08b90c871f"
format_stamp: "Formatted at 2026-08-06 15:54:59 on dist-test-slave-mn4r"
I20260806 15:54:59.659255 13669 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 15:54:59.661721 13685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:59.663092 13669 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 15:54:59.663233 13669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "bb3aba5c6068409ea525fe08b90c871f"
format_stamp: "Formatted at 2026-08-06 15:54:59 on dist-test-slave-mn4r"
I20260806 15:54:59.663333 13669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:54:59.700778 13669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:54:59.701534 13669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:54:59.701735 13669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:54:59.702395 13669 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:54:59.703393 13669 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:54:59.703470 13669 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:59.703544 13669 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:54:59.703593 13669 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:59.712507 13669 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.194:42231
I20260806 15:54:59.712538 13807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.194:42231 every 8 connection(s)
I20260806 15:54:59.713455 13669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260806 15:54:59.722142 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 13669
I20260806 15:54:59.722266 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260806 15:54:59.724426 13808 heartbeater.cc:347] Connected to a master server at 127.10.189.254:42375
I20260806 15:54:59.724684 13808 heartbeater.cc:464] Registering TS with master...
I20260806 15:54:59.724711 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.195:0
--local_ip_for_outbound_sockets=127.10.189.195
--webserver_interface=127.10.189.195
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42375
--builtin_ntp_servers=127.10.189.212:33423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--inject_latency_ms_before_starting_op=1000
--consensus_inject_latency_ms_in_notifications=50 with env {}
I20260806 15:54:59.725252 13808 heartbeater.cc:511] Master 127.10.189.254:42375 requested a full tablet report, sending...
I20260806 15:54:59.726423 13465 ts_manager.cc:194] Registered new tserver with Master: bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:54:59.727351 13465 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.194:53281
W20260806 15:54:59.837098 13812 flags.cc:425] Enabled unsafe flag: --consensus_inject_latency_ms_in_notifications=50
W20260806 15:54:59.837411 13812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:54:59.837468 13812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:54:59.837538 13812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:54:59.841900 13812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:54:59.842073 13812 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.195
I20260806 15:54:59.847177 13812 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:33423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_inject_latency_ms_in_notifications=50
--raft_heartbeat_interval_ms=2
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.189.195
--webserver_port=0
--inject_latency_ms_before_starting_op=1000
--tserver_master_addrs=127.10.189.254:42375
--never_fsync=true
--heap_profile_path=/tmp/kudu.13812
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.195
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:54:59.848240 13812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:54:59.849640 13812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:54:59.859280 13817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:54:59.859328 13820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:54:59.859280 13818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:54:59.859619 13812 server_base.cc:1034] running on GCE node
I20260806 15:54:59.860021 13812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:54:59.860680 13812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:54:59.861898 13812 hybrid_clock.cc:648] HybridClock initialized: now 1786031699861870 us; error 39 us; skew 500 ppm
I20260806 15:54:59.863868 13812 webserver.cc:460] Webserver started at http://127.10.189.195:41135/ using document root <none> and password file <none>
I20260806 15:54:59.864493 13812 fs_manager.cc:359] Metadata directory not provided
I20260806 15:54:59.864583 13812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:54:59.864809 13812 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:54:59.866881 13812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "244ee99675694dc096cd316813818bd9"
format_stamp: "Formatted at 2026-08-06 15:54:59 on dist-test-slave-mn4r"
I20260806 15:54:59.867528 13812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "244ee99675694dc096cd316813818bd9"
format_stamp: "Formatted at 2026-08-06 15:54:59 on dist-test-slave-mn4r"
I20260806 15:54:59.871362 13812 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 15:54:59.873764 13827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:59.875099 13812 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 15:54:59.875238 13812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "244ee99675694dc096cd316813818bd9"
format_stamp: "Formatted at 2026-08-06 15:54:59 on dist-test-slave-mn4r"
I20260806 15:54:59.875347 13812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:54:59.896051 13812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:54:59.896740 13812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:54:59.896936 13812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:54:59.897531 13812 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:54:59.898491 13812 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:54:59.898561 13812 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:59.898630 13812 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:54:59.898676 13812 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:54:59.907224 13812 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.195:35263
I20260806 15:54:59.907290 13944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.195:35263 every 8 connection(s)
I20260806 15:54:59.908154 13812 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260806 15:54:59.911916 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 13812
I20260806 15:54:59.912043 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260806 15:54:59.918625 13945 heartbeater.cc:347] Connected to a master server at 127.10.189.254:42375
I20260806 15:54:59.918851 13945 heartbeater.cc:464] Registering TS with master...
I20260806 15:54:59.919369 13945 heartbeater.cc:511] Master 127.10.189.254:42375 requested a full tablet report, sending...
I20260806 15:54:59.920361 13465 ts_manager.cc:194] Registered new tserver with Master: 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263)
I20260806 15:54:59.920961 13465 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.195:59023
I20260806 15:54:59.926007 10999 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:54:59.927578 10999 test_util.cc:268] Using random seed: -385342953
I20260806 15:54:59.938046 13465 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35244:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:54:59.939227 13465 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:54:59.956223 13592 tablet_service.cc:1467] Processing CreateTablet for tablet c4200ab19d2947ec8e84e935ab5c6fc4 (DEFAULT_TABLE table=test-workload [id=061b948706c4455e94574bb54ebf346e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:54:59.956458 13736 tablet_service.cc:1467] Processing CreateTablet for tablet c4200ab19d2947ec8e84e935ab5c6fc4 (DEFAULT_TABLE table=test-workload [id=061b948706c4455e94574bb54ebf346e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:54:59.956449 13875 tablet_service.cc:1467] Processing CreateTablet for tablet c4200ab19d2947ec8e84e935ab5c6fc4 (DEFAULT_TABLE table=test-workload [id=061b948706c4455e94574bb54ebf346e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:54:59.957252 13592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4200ab19d2947ec8e84e935ab5c6fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:54:59.957466 13736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4200ab19d2947ec8e84e935ab5c6fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:54:59.957460 13875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4200ab19d2947ec8e84e935ab5c6fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:54:59.963201 13964 tablet_bootstrap.cc:492] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae: Bootstrap starting.
I20260806 15:54:59.964217 13965 tablet_bootstrap.cc:492] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9: Bootstrap starting.
I20260806 15:54:59.965109 13966 tablet_bootstrap.cc:492] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f: Bootstrap starting.
I20260806 15:54:59.965672 13964 tablet_bootstrap.cc:654] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae: Neither blocks nor log segments found. Creating new log.
I20260806 15:54:59.966481 13965 tablet_bootstrap.cc:654] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9: Neither blocks nor log segments found. Creating new log.
I20260806 15:54:59.966614 13964 log.cc:824] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae: Log is configured to *not* fsync() on all Append() calls
I20260806 15:54:59.967083 13966 tablet_bootstrap.cc:654] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f: Neither blocks nor log segments found. Creating new log.
I20260806 15:54:59.967338 13965 log.cc:824] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9: Log is configured to *not* fsync() on all Append() calls
I20260806 15:54:59.967929 13966 log.cc:824] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f: Log is configured to *not* fsync() on all Append() calls
I20260806 15:54:59.968806 13964 tablet_bootstrap.cc:492] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae: No bootstrap required, opened a new log
I20260806 15:54:59.969053 13964 ts_tablet_manager.cc:1397] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 15:54:59.969242 13965 tablet_bootstrap.cc:492] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9: No bootstrap required, opened a new log
I20260806 15:54:59.969429 13965 ts_tablet_manager.cc:1397] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260806 15:54:59.969709 13966 tablet_bootstrap.cc:492] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f: No bootstrap required, opened a new log
I20260806 15:54:59.969890 13966 ts_tablet_manager.cc:1397] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260806 15:54:59.973023 13966 raft_consensus.cc:348] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:54:59.973274 13966 raft_consensus.cc:374] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:54:59.973348 13966 raft_consensus.cc:729] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb3aba5c6068409ea525fe08b90c871f, State: Initialized, Role: FOLLOWER
I20260806 15:54:59.973724 13964 raft_consensus.cc:348] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:54:59.973724 13965 raft_consensus.cc:348] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:54:59.973974 13965 raft_consensus.cc:374] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:54:59.973974 13964 raft_consensus.cc:374] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:54:59.973888 13966 consensus_queue.cc:260] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:54:59.974035 13964 raft_consensus.cc:729] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31b5f45092c144fe97d06a04bed2a7ae, State: Initialized, Role: FOLLOWER
I20260806 15:54:59.974069 13965 raft_consensus.cc:729] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 244ee99675694dc096cd316813818bd9, State: Initialized, Role: FOLLOWER
I20260806 15:54:59.974193 13970 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:54:59.974368 13970 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:54:59.974560 13964 consensus_queue.cc:260] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:54:59.974545 13965 consensus_queue.cc:260] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:54:59.975025 13966 ts_tablet_manager.cc:1428] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f: Time spent starting tablet: real 0.005s user 0.002s sys 0.004s
I20260806 15:54:59.975453 13808 heartbeater.cc:503] Master 127.10.189.254:42375 was elected leader, sending a full tablet report...
I20260806 15:54:59.975636 13964 ts_tablet_manager.cc:1428] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260806 15:54:59.975930 13666 heartbeater.cc:503] Master 127.10.189.254:42375 was elected leader, sending a full tablet report...
I20260806 15:54:59.977103 13970 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263)
I20260806 15:54:59.977665 13945 heartbeater.cc:503] Master 127.10.189.254:42375 was elected leader, sending a full tablet report...
I20260806 15:54:59.979383 13975 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:54:59.979734 13975 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:54:59.982468 13973 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:54:59.982506 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "bb3aba5c6068409ea525fe08b90c871f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:54:59.982659 13973 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:54:59.983022 13615 raft_consensus.cc:2454] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb3aba5c6068409ea525fe08b90c871f in term 0.
I20260806 15:54:59.983045 13975 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:54:59.983443 13896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "bb3aba5c6068409ea525fe08b90c871f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
W20260806 15:54:59.983547 13690 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.189.193:38717 timed out after 0.007s (SENT)
I20260806 15:54:59.983633 13896 raft_consensus.cc:2454] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb3aba5c6068409ea525fe08b90c871f in term 0.
I20260806 15:54:59.984732 13965 ts_tablet_manager.cc:1428] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9: Time spent starting tablet: real 0.015s user 0.004s sys 0.004s
I20260806 15:54:59.985131 13973 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:54:59.986876 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "bb3aba5c6068409ea525fe08b90c871f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:54:59.986989 13615 raft_consensus.cc:2454] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb3aba5c6068409ea525fe08b90c871f in term 0.
I20260806 15:54:59.987300 13896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "bb3aba5c6068409ea525fe08b90c871f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:54:59.987327 13690 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f; no voters:
I20260806 15:54:59.987408 13896 raft_consensus.cc:2454] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb3aba5c6068409ea525fe08b90c871f in term 0.
I20260806 15:54:59.987633 13971 raft_consensus.cc:2781] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:54:59.987726 13971 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260806 15:54:59.987742 13831 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.10.189.193:38717 for RPC RequestConsensusVote timed out after 0.006s (ON_OUTBOUND_QUEUE)
I20260806 15:54:59.987800 13971 raft_consensus.cc:3037] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:54:59.989199 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:54:59.989307 13615 raft_consensus.cc:2454] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 244ee99675694dc096cd316813818bd9 in term 0.
I20260806 15:54:59.989295 13971 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:54:59.989642 13971 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f [CANDIDATE]: Term 1 election: Requested vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263)
I20260806 15:54:59.989676 13831 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 244ee99675694dc096cd316813818bd9, 31b5f45092c144fe97d06a04bed2a7ae; no voters:
I20260806 15:54:59.990046 13896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:54:59.990181 13896 raft_consensus.cc:2454] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31b5f45092c144fe97d06a04bed2a7ae in term 0.
W20260806 15:54:59.990325 13544 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.189.195:35263 timed out after 0.006s (SENT)
I20260806 15:54:59.990331 13894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "bb3aba5c6068409ea525fe08b90c871f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9"
I20260806 15:54:59.990437 13972 raft_consensus.cc:2781] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:54:59.990540 13972 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:54:59.990551 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "bb3aba5c6068409ea525fe08b90c871f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae"
I20260806 15:54:59.990602 13972 raft_consensus.cc:3037] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:54:59.990641 13615 raft_consensus.cc:3037] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:54:59.991966 13615 raft_consensus.cc:2454] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb3aba5c6068409ea525fe08b90c871f in term 1.
I20260806 15:54:59.992337 13690 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f; no voters:
I20260806 15:54:59.992591 13971 raft_consensus.cc:2781] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:54:59.992584 13972 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:54:59.992693 13971 raft_consensus.cc:686] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f [term 1 LEADER]: Becoming Leader. State: Replica: bb3aba5c6068409ea525fe08b90c871f, State: Running, Role: LEADER
I20260806 15:54:59.992841 13894 raft_consensus.cc:2379] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bb3aba5c6068409ea525fe08b90c871f in current term 1: Already voted for candidate 244ee99675694dc096cd316813818bd9 in this term.
I20260806 15:54:59.992983 13971 consensus_queue.cc:237] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:54:59.993271 13896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:54:59.993868 13972 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 1 election: Requested vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:54:59.994573 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae"
I20260806 15:54:59.994757 13615 raft_consensus.cc:2379] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 244ee99675694dc096cd316813818bd9 in current term 1: Already voted for candidate bb3aba5c6068409ea525fe08b90c871f in this term.
I20260806 15:54:59.994792 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f"
I20260806 15:54:59.995359 13831 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:54:59.995716 13972 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260806 15:54:59.996665 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:54:59.996795 13462 catalog_manager.cc:5495] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae reported cstate change: term changed from 0 to 1, leader changed from <none> to bb3aba5c6068409ea525fe08b90c871f (127.10.189.194). New cstate: current_term: 1 leader_uuid: "bb3aba5c6068409ea525fe08b90c871f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } } }
W20260806 15:54:59.997648 13971 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260806 15:54:59.997717 13971 fault_injection.cc:44] THIS SERVER MAY CRASH!
I20260806 15:54:59.999186 13985 consensus_queue.cc:1035] T c4200ab19d2947ec8e84e935ab5c6fc4 P bb3aba5c6068409ea525fe08b90c871f [LEADER]: Connected to new peer: Peer: permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 15:55:00.000473 13543 leader_election.cc:334] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231): Timed out: RequestConsensusVote RPC to 127.10.189.194:42231 timed out after 0.006s (ON_OUTBOUND_QUEUE)
I20260806 15:55:00.000562 13543 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:00.000798 13973 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260806 15:55:00.004148 13667 tablet.cc:2369] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 15:55:00.050601 13894 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260806 15:55:00.050674 13894 fault_injection.cc:44] THIS SERVER MAY CRASH!
W20260806 15:55:00.050631 13615 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260806 15:55:00.050704 13615 fault_injection.cc:44] THIS SERVER MAY CRASH!
I20260806 15:55:00.117492 13973 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:00.117652 13973 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:00.118583 13973 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:00.119145 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:00.119145 13896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:00.119581 13544 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:00.120158 13973 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:00.706264 13972 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:00.706424 13972 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:00.707325 13972 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:00.707790 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:00.708060 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:00.708398 13831 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:00.708600 13972 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:00.761907 13997 mvcc.cc:205] Tried to move back new op lower bound from 7315585843302481920 to 7315585843174428672. Current Snapshot: MvccSnapshot[applied={T|T < 7315585843302481920 or (T in {7315585843302481920})}]
I20260806 15:55:01.164469 14003 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:01.164781 14003 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:01.165460 14003 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:01.165941 13896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:01.165942 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:01.166889 13543 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:01.195809 14007 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=1, attempt_no=0}) took 1175 ms. Trace:
I20260806 15:55:01.195976 14007 rpcz_store.cc:276] 0806 15:55:00.020653 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:00.020720 (+ 67us) service_pool.cc:227] Handling call
0806 15:55:01.195765 (+1175045us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:00.049041 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:00.049144 (+ 103us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:00.049148 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:00.049149 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:00.049212 (+ 63us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:00.049239 (+ 27us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:00.049241 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:00.049275 (+ 34us) tablet.cc:699] Row locks acquired
0806 15:55:00.049276 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:00.049316 (+ 40us) write_op.cc:270] Start()
0806 15:55:00.761459 (+712143us) write_op.cc:276] Timestamp: P: 1786031700049267 usec, L: 0
0806 15:55:00.761462 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:55:00.761748 (+ 286us) log.cc:842] Serialized 345 byte log entry
0806 15:55:01.194993 (+433245us) op_driver.cc:444] REPLICATION: finished
0806 15:55:01.195288 (+ 295us) write_op.cc:301] APPLY: starting
0806 15:55:01.195306 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:01.195334 (+ 28us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:01.195351 (+ 17us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:01.195427 (+ 76us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:01.195460 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:01.195463 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:01.195531 (+ 68us) log.cc:842] Serialized 22 byte log entry
0806 15:55:01.195654 (+ 123us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:01.195670 (+ 16us) write_op.cc:454] Released schema lock
0806 15:55:01.195676 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":1852160,"child_traces":[["op",{"apply.queue_time_us":196,"mutex_wait_us":72,"num_ops":1,"prepare.queue_time_us":25809,"prepare.run_cpu_time_us":746,"prepare.run_wall_time_us":712805,"raft.queue_time_us":45,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":187,"replication_time_us":433484,"thread_start_us":82,"threads_started":1}]]}
I20260806 15:55:01.199644 13714 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:36064 (request call id 4) took 1035 ms. Trace:
I20260806 15:55:01.199651 13715 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:36064 (request call id 3) took 1035 ms. Trace:
I20260806 15:55:01.199740 13714 rpcz_store.cc:276] 0806 15:55:00.164305 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:00.164376 (+ 71us) service_pool.cc:227] Handling call
0806 15:55:00.164492 (+ 116us) tablet_service.cc:2780] Created scanner a77156e5e4ef42cfad1ee1e92d1670e5 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 1c968871887843468875eb9d2d20826d
0806 15:55:00.166007 (+ 1515us) tablet_service.cc:2920] Creating iterator
0806 15:55:00.166047 (+ 40us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:55:00.761664 (+595617us) tablet_service.cc:3304] Waiting for operations to commit
0806 15:55:01.195688 (+434024us) tablet_service.cc:3320] All operations in snapshot committed. Waited for 1029625 microseconds
0806 15:55:01.195925 (+ 237us) tablet_service.cc:2945] Iterator created
0806 15:55:01.197611 (+ 1686us) tablet_service.cc:2967] Iterator init: OK
0806 15:55:01.197669 (+ 58us) tablet_service.cc:3010] has_more: true
0806 15:55:01.197767 (+ 98us) tablet_service.cc:3027] Continuing scan request
0806 15:55:01.197911 (+ 144us) tablet_service.cc:3091] Found scanner a77156e5e4ef42cfad1ee1e92d1670e5 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 1c968871887843468875eb9d2d20826d
0806 15:55:01.199635 (+ 1724us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":32,"rowset_iterators":1,"scanner_bytes_read":0,"spinlock_wait_cycles":406272}
I20260806 15:55:01.199860 13715 rpcz_store.cc:276] 0806 15:55:00.163872 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:00.163934 (+ 62us) service_pool.cc:227] Handling call
0806 15:55:00.164383 (+ 449us) tablet_service.cc:2780] Created scanner c1fd03ae5ae14db8b157fceab5dee4f6 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 87c13fff3786422086a099480b0a5dbc
0806 15:55:00.165978 (+ 1595us) tablet_service.cc:2920] Creating iterator
0806 15:55:00.166047 (+ 69us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:55:00.761664 (+595617us) tablet_service.cc:3304] Waiting for operations to commit
0806 15:55:01.195691 (+434027us) tablet_service.cc:3320] All operations in snapshot committed. Waited for 1029625 microseconds
0806 15:55:01.195924 (+ 233us) tablet_service.cc:2945] Iterator created
0806 15:55:01.197615 (+ 1691us) tablet_service.cc:2967] Iterator init: OK
0806 15:55:01.197671 (+ 56us) tablet_service.cc:3010] has_more: true
0806 15:55:01.197765 (+ 94us) tablet_service.cc:3027] Continuing scan request
0806 15:55:01.197910 (+ 145us) tablet_service.cc:3091] Found scanner c1fd03ae5ae14db8b157fceab5dee4f6 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 87c13fff3786422086a099480b0a5dbc
0806 15:55:01.199637 (+ 1727us) inbound_call.cc:173] Queueing success response
Metrics: {"compiler_manager_pool.queue_time_us":208,"rowset_iterators":1,"scanner_bytes_read":0,"spinlock_wait_cycles":63488,"thread_start_us":73,"threads_started":1}
W20260806 15:55:01.200400 13994 scanner-internal.cc:458] Time spent opening tablet: real 1.037s user 0.000s sys 0.000s
W20260806 15:55:01.200400 13995 scanner-internal.cc:458] Time spent opening tablet: real 1.037s user 0.001s sys 0.000s
I20260806 15:55:01.610749 13972 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:01.610915 13972 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:01.611466 13972 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:01.612041 13614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:01.612113 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:01.612581 13831 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:01.843585 13972 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:01.849504 14013 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=2, attempt_no=0}) took 1696 ms. Trace:
I20260806 15:55:01.849610 14013 rpcz_store.cc:276] 0806 15:55:00.153153 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:00.153211 (+ 58us) service_pool.cc:227] Handling call
0806 15:55:01.849481 (+1696270us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:00.762135 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:00.762240 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:00.762245 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:55:00.762247 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:00.762328 (+ 81us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:00.762340 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:00.762342 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:00.762385 (+ 43us) tablet.cc:699] Row locks acquired
0806 15:55:00.762386 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:00.762435 (+ 49us) write_op.cc:270] Start()
0806 15:55:01.108604 (+346169us) write_op.cc:276] Timestamp: P: 1786031700762405 usec, L: 0
0806 15:55:01.108608 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:01.108904 (+ 296us) log.cc:842] Serialized 354 byte log entry
0806 15:55:01.848831 (+739927us) op_driver.cc:444] REPLICATION: finished
0806 15:55:01.849115 (+ 284us) write_op.cc:301] APPLY: starting
0806 15:55:01.849132 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:01.849160 (+ 28us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:01.849175 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:01.849227 (+ 52us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:01.849271 (+ 44us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:01.849275 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:55:01.849339 (+ 64us) log.cc:842] Serialized 22 byte log entry
0806 15:55:01.849397 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:01.849408 (+ 11us) write_op.cc:454] Released schema lock
0806 15:55:01.849413 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":220,"num_ops":1,"prepare.queue_time_us":608456,"prepare.run_cpu_time_us":778,"prepare.run_wall_time_us":346850,"replication_time_us":740188,"thread_start_us":130,"threads_started":1}]]}
I20260806 15:55:01.852674 14003 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:02.705057 14003 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:02.705224 14003 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:02.705777 14003 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:02.706202 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:02.706259 13896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:02.706776 13544 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:02.706985 14003 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:02.709930 14020 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=3, attempt_no=0}) took 1511 ms. Trace:
I20260806 15:55:02.710062 14020 rpcz_store.cc:276] 0806 15:55:01.198685 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:01.198732 (+ 47us) service_pool.cc:227] Handling call
0806 15:55:02.709915 (+1511183us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:01.199214 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:01.199284 (+ 70us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:01.199288 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:01.199289 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:01.199352 (+ 63us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:01.199359 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:01.199361 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:01.199393 (+ 32us) tablet.cc:699] Row locks acquired
0806 15:55:01.199395 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:55:01.199422 (+ 27us) write_op.cc:270] Start()
0806 15:55:02.152587 (+953165us) write_op.cc:276] Timestamp: P: 1786031701199415 usec, L: 0
0806 15:55:02.152591 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:02.152832 (+ 241us) log.cc:842] Serialized 354 byte log entry
0806 15:55:02.709378 (+556546us) op_driver.cc:444] REPLICATION: finished
0806 15:55:02.709596 (+ 218us) write_op.cc:301] APPLY: starting
0806 15:55:02.709614 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:02.709635 (+ 21us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:02.709647 (+ 12us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:02.709689 (+ 42us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:02.709709 (+ 20us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:02.709712 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:02.709759 (+ 47us) log.cc:842] Serialized 22 byte log entry
0806 15:55:02.709840 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:02.709852 (+ 12us) write_op.cc:454] Released schema lock
0806 15:55:02.709856 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":168,"num_ops":1,"prepare.queue_time_us":54,"prepare.run_cpu_time_us":652,"prepare.run_wall_time_us":953717,"replication_time_us":556764,"thread_start_us":72,"threads_started":1}]]}
I20260806 15:55:02.711047 13715 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:36064 (request call id 7) took 1359 ms. Trace:
I20260806 15:55:02.711123 13715 rpcz_store.cc:276] 0806 15:55:01.351746 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:01.351800 (+ 54us) service_pool.cc:227] Handling call
0806 15:55:01.351961 (+ 161us) tablet_service.cc:2780] Created scanner 406d17993c364c4b826f7b546149cecb for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is e10997d575094d3eb61d10697bcdd6f7
0806 15:55:01.352233 (+ 272us) tablet_service.cc:2920] Creating iterator
0806 15:55:01.352259 (+ 26us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:55:02.152713 (+800454us) tablet_service.cc:3304] Waiting for operations to commit
0806 15:55:02.709866 (+557153us) tablet_service.cc:3320] All operations in snapshot committed. Waited for 1357596 microseconds
0806 15:55:02.710008 (+ 142us) tablet_service.cc:2945] Iterator created
0806 15:55:02.710523 (+ 515us) tablet_service.cc:2967] Iterator init: OK
0806 15:55:02.710548 (+ 25us) tablet_service.cc:3010] has_more: true
0806 15:55:02.710575 (+ 27us) tablet_service.cc:3027] Continuing scan request
0806 15:55:02.710630 (+ 55us) tablet_service.cc:3091] Found scanner 406d17993c364c4b826f7b546149cecb for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is e10997d575094d3eb61d10697bcdd6f7
0806 15:55:02.711035 (+ 405us) inbound_call.cc:173] Queueing success response
Metrics: {"rowset_iterators":1,"scanner_bytes_read":0,"spinlock_wait_cycles":19968}
I20260806 15:55:02.711066 13714 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:36064 (request call id 6) took 1359 ms. Trace:
I20260806 15:55:02.711316 13714 rpcz_store.cc:276] 0806 15:55:01.351687 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:01.351761 (+ 74us) service_pool.cc:227] Handling call
0806 15:55:01.351977 (+ 216us) tablet_service.cc:2780] Created scanner e83b3e7fe0e44c9dbc9ce6f973e1c129 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 6d1ab8eea1794f0cb915ab91f47d144c
0806 15:55:01.352333 (+ 356us) tablet_service.cc:2920] Creating iterator
0806 15:55:01.352390 (+ 57us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:55:02.152712 (+800322us) tablet_service.cc:3304] Waiting for operations to commit
0806 15:55:02.709861 (+557149us) tablet_service.cc:3320] All operations in snapshot committed. Waited for 1357456 microseconds
0806 15:55:02.709976 (+ 115us) tablet_service.cc:2945] Iterator created
0806 15:55:02.710530 (+ 554us) tablet_service.cc:2967] Iterator init: OK
0806 15:55:02.710568 (+ 38us) tablet_service.cc:3010] has_more: true
0806 15:55:02.710598 (+ 30us) tablet_service.cc:3027] Continuing scan request
0806 15:55:02.710644 (+ 46us) tablet_service.cc:3091] Found scanner e83b3e7fe0e44c9dbc9ce6f973e1c129 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 6d1ab8eea1794f0cb915ab91f47d144c
0806 15:55:02.711053 (+ 409us) inbound_call.cc:173] Queueing success response
Metrics: {"rowset_iterators":1,"scanner_bytes_read":0,"spinlock_wait_cycles":40704}
W20260806 15:55:02.711673 13995 scanner-internal.cc:458] Time spent opening tablet: real 1.361s user 0.001s sys 0.000s
W20260806 15:55:02.712051 13994 scanner-internal.cc:458] Time spent opening tablet: real 1.361s user 0.001s sys 0.000s
I20260806 15:55:02.973290 13972 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:02.973440 13972 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:02.973963 13972 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:02.974360 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:02.974385 13614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:02.974958 13829 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:03.146880 13972 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:03.177923 14003 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:03.178079 14003 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:03.178630 14003 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:03.178854 13896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:03.179641 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:03.180039 13543 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:03.180217 14003 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:03.185446 14020 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=4, attempt_no=0}) took 1334 ms. Trace:
I20260806 15:55:03.185529 14020 rpcz_store.cc:276] 0806 15:55:01.850945 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:01.851013 (+ 68us) service_pool.cc:227] Handling call
0806 15:55:03.185433 (+1334420us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:02.152964 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:02.153087 (+ 123us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:02.153092 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:55:02.153093 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:02.153177 (+ 84us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:02.153187 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:02.153190 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:02.153247 (+ 57us) tablet.cc:699] Row locks acquired
0806 15:55:02.153248 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:02.153310 (+ 62us) write_op.cc:270] Start()
0806 15:55:02.949480 (+796170us) write_op.cc:276] Timestamp: P: 1786031702153198 usec, L: 0
0806 15:55:02.949484 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:02.949725 (+ 241us) log.cc:842] Serialized 354 byte log entry
0806 15:55:03.184942 (+235217us) op_driver.cc:444] REPLICATION: finished
0806 15:55:03.185066 (+ 124us) write_op.cc:301] APPLY: starting
0806 15:55:03.185082 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:03.185108 (+ 26us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:03.185126 (+ 18us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:03.185174 (+ 48us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:03.185198 (+ 24us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:03.185201 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:03.185254 (+ 53us) log.cc:842] Serialized 22 byte log entry
0806 15:55:03.185334 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:03.185346 (+ 12us) write_op.cc:454] Released schema lock
0806 15:55:03.185351 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":43,"num_ops":1,"prepare.queue_time_us":301538,"prepare.run_cpu_time_us":773,"prepare.run_wall_time_us":796829,"replication_time_us":235433}]]}
I20260806 15:55:04.393260 14027 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:04.393415 14027 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:04.393934 14027 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:04.394368 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:04.394428 13894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:04.394865 13544 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:04.395057 14027 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:04.396265 14033 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=5, attempt_no=0}) took 1684 ms. Trace:
I20260806 15:55:04.396358 14033 rpcz_store.cc:276] 0806 15:55:02.712038 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:02.712131 (+ 93us) service_pool.cc:227] Handling call
0806 15:55:04.396250 (+1684119us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:02.949827 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:02.949955 (+ 128us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:02.949960 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:55:02.949961 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:02.950046 (+ 85us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:02.950057 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:02.950063 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:02.950136 (+ 73us) tablet.cc:699] Row locks acquired
0806 15:55:02.950138 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:55:02.950168 (+ 30us) write_op.cc:270] Start()
0806 15:55:03.801327 (+851159us) write_op.cc:276] Timestamp: P: 1786031702950123 usec, L: 0
0806 15:55:03.801331 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:03.801644 (+ 313us) log.cc:842] Serialized 354 byte log entry
0806 15:55:04.395655 (+594011us) op_driver.cc:444] REPLICATION: finished
0806 15:55:04.395896 (+ 241us) write_op.cc:301] APPLY: starting
0806 15:55:04.395909 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:04.395931 (+ 22us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:04.395945 (+ 14us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:04.395991 (+ 46us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:04.396029 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:04.396032 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:04.396079 (+ 47us) log.cc:842] Serialized 22 byte log entry
0806 15:55:04.396170 (+ 91us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:04.396180 (+ 10us) write_op.cc:454] Released schema lock
0806 15:55:04.396185 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":196,"num_ops":1,"prepare.queue_time_us":237325,"prepare.run_cpu_time_us":819,"prepare.run_wall_time_us":851902,"raft.queue_time_us":43,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":179,"replication_time_us":594303,"spinlock_wait_cycles":111360,"thread_start_us":87,"threads_started":1}]]}
I20260806 15:55:04.397022 13714 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:36064 (request call id 14) took 1059 ms. Trace:
I20260806 15:55:04.397030 13715 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:36064 (request call id 13) took 1059 ms. Trace:
I20260806 15:55:04.397132 13715 rpcz_store.cc:276] 0806 15:55:03.337648 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:03.337756 (+ 108us) service_pool.cc:227] Handling call
0806 15:55:03.337917 (+ 161us) tablet_service.cc:2780] Created scanner 7c1a1206a41b4fb6974dd6f620f843fd for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 92bb25733da04624b79b9f0f363bc87f
0806 15:55:03.338191 (+ 274us) tablet_service.cc:2920] Creating iterator
0806 15:55:03.338269 (+ 78us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:55:03.801544 (+463275us) tablet_service.cc:3304] Waiting for operations to commit
0806 15:55:04.396199 (+594655us) tablet_service.cc:3320] All operations in snapshot committed. Waited for 1057923 microseconds
0806 15:55:04.396282 (+ 83us) tablet_service.cc:2945] Iterator created
0806 15:55:04.396574 (+ 292us) tablet_service.cc:2967] Iterator init: OK
0806 15:55:04.396601 (+ 27us) tablet_service.cc:3010] has_more: true
0806 15:55:04.396628 (+ 27us) tablet_service.cc:3027] Continuing scan request
0806 15:55:04.396674 (+ 46us) tablet_service.cc:3091] Found scanner 7c1a1206a41b4fb6974dd6f620f843fd for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 92bb25733da04624b79b9f0f363bc87f
0806 15:55:04.397025 (+ 351us) inbound_call.cc:173] Queueing success response
Metrics: {"rowset_iterators":1,"scanner_bytes_read":0,"spinlock_wait_cycles":115968}
I20260806 15:55:04.397117 13714 rpcz_store.cc:276] 0806 15:55:03.337751 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:03.337860 (+ 109us) service_pool.cc:227] Handling call
0806 15:55:03.337988 (+ 128us) tablet_service.cc:2780] Created scanner a4801319e71746d2bc3431ca737f1089 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 3fb360fa7a4546d2bc6a8d4af266e0f8
0806 15:55:03.338214 (+ 226us) tablet_service.cc:2920] Creating iterator
0806 15:55:03.338242 (+ 28us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:55:03.801517 (+463275us) tablet_service.cc:3304] Waiting for operations to commit
0806 15:55:04.396197 (+594680us) tablet_service.cc:3320] All operations in snapshot committed. Waited for 1057942 microseconds
0806 15:55:04.396282 (+ 85us) tablet_service.cc:2945] Iterator created
0806 15:55:04.396574 (+ 292us) tablet_service.cc:2967] Iterator init: OK
0806 15:55:04.396598 (+ 24us) tablet_service.cc:3010] has_more: true
0806 15:55:04.396628 (+ 30us) tablet_service.cc:3027] Continuing scan request
0806 15:55:04.396674 (+ 46us) tablet_service.cc:3091] Found scanner a4801319e71746d2bc3431ca737f1089 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 3fb360fa7a4546d2bc6a8d4af266e0f8
0806 15:55:04.397012 (+ 338us) inbound_call.cc:173] Queueing success response
Metrics: {"rowset_iterators":1,"scanner_bytes_read":0,"spinlock_wait_cycles":1536}
W20260806 15:55:04.397598 13994 scanner-internal.cc:458] Time spent opening tablet: real 1.060s user 0.001s sys 0.000s
W20260806 15:55:04.397650 13995 scanner-internal.cc:458] Time spent opening tablet: real 1.061s user 0.001s sys 0.000s
I20260806 15:55:04.444414 14026 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:04.444586 14026 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:04.445264 14026 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:04.445681 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:04.445714 13614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:04.446256 13831 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:05.192272 14027 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:05.192449 14027 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:05.192996 14027 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:05.193432 13894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:05.193881 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:05.194273 13543 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:05.194456 14027 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:05.197273 14042 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=6, attempt_no=0}) took 2010 ms. Trace:
I20260806 15:55:05.197338 14042 rpcz_store.cc:276] 0806 15:55:03.187195 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:03.187235 (+ 40us) service_pool.cc:227] Handling call
0806 15:55:05.197259 (+2010024us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:03.801756 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:03.801875 (+ 119us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:03.801879 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:03.801880 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:03.801993 (+ 113us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:03.802002 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:03.802006 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:03.802053 (+ 47us) tablet.cc:699] Row locks acquired
0806 15:55:03.802054 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:03.802116 (+ 62us) write_op.cc:270] Start()
0806 15:55:03.825293 (+ 23177us) write_op.cc:276] Timestamp: P: 1786031703802092 usec, L: 0
0806 15:55:03.825298 (+ 5us) op_driver.cc:331] REPLICATION: starting
0806 15:55:03.825501 (+ 203us) log.cc:842] Serialized 354 byte log entry
0806 15:55:05.196801 (+1371300us) op_driver.cc:444] REPLICATION: finished
0806 15:55:05.196994 (+ 193us) write_op.cc:301] APPLY: starting
0806 15:55:05.197006 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:05.197025 (+ 19us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:05.197037 (+ 12us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:05.197086 (+ 49us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:05.197106 (+ 20us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:05.197108 (+ 2us) write_op.cc:312] APPLY: finished
0806 15:55:05.197154 (+ 46us) log.cc:842] Serialized 22 byte log entry
0806 15:55:05.197198 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:05.197206 (+ 8us) write_op.cc:454] Released schema lock
0806 15:55:05.197210 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":144,"num_ops":1,"prepare.queue_time_us":614185,"prepare.run_cpu_time_us":761,"prepare.run_wall_time_us":23840,"replication_time_us":1371479,"thread_start_us":63,"threads_started":1}]]}
I20260806 15:55:05.435094 14026 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:05.814801 14027 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:05.814960 14027 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:05.815559 14027 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:05.815958 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:05.815972 13894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:05.816452 13544 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:05.836807 14049 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=7, attempt_no=0}) took 1438 ms. Trace:
I20260806 15:55:05.836931 14049 rpcz_store.cc:276] 0806 15:55:04.397984 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:04.398030 (+ 46us) service_pool.cc:227] Handling call
0806 15:55:05.836785 (+1438755us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:04.398498 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:04.398563 (+ 65us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:04.398565 (+ 2us) write_op.cc:435] Acquired schema lock
0806 15:55:04.398566 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:04.398618 (+ 52us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:04.398623 (+ 5us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:04.398625 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:04.398653 (+ 28us) tablet.cc:699] Row locks acquired
0806 15:55:04.398654 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:04.398677 (+ 23us) write_op.cc:270] Start()
0806 15:55:05.142830 (+744153us) write_op.cc:276] Timestamp: P: 1786031704398652 usec, L: 0
0806 15:55:05.142835 (+ 5us) op_driver.cc:331] REPLICATION: starting
0806 15:55:05.143157 (+ 322us) log.cc:842] Serialized 354 byte log entry
0806 15:55:05.835984 (+692827us) op_driver.cc:444] REPLICATION: finished
0806 15:55:05.836266 (+ 282us) write_op.cc:301] APPLY: starting
0806 15:55:05.836285 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:05.836321 (+ 36us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:05.836339 (+ 18us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:05.836416 (+ 77us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:05.836442 (+ 26us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:05.836445 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:05.836513 (+ 68us) log.cc:842] Serialized 22 byte log entry
0806 15:55:05.836623 (+ 110us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:05.836638 (+ 15us) write_op.cc:454] Released schema lock
0806 15:55:05.836644 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":211,"num_ops":1,"prepare.queue_time_us":111,"prepare.run_cpu_time_us":660,"prepare.run_wall_time_us":744725,"replication_time_us":693105,"thread_start_us":151,"threads_started":2}]]}
I20260806 15:55:05.837589 13714 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:36064 (request call id 16) took 1288 ms. Trace:
I20260806 15:55:05.837604 13715 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:36064 (request call id 17) took 1288 ms. Trace:
I20260806 15:55:05.837709 13715 rpcz_store.cc:276] 0806 15:55:04.549066 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:04.549105 (+ 39us) service_pool.cc:227] Handling call
0806 15:55:04.549268 (+ 163us) tablet_service.cc:2780] Created scanner 4f103d9f7cd74df093d7a9623199b3cd for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 9675d01380214ae5b2ce5aee3941a353
0806 15:55:04.549448 (+ 180us) tablet_service.cc:2920] Creating iterator
0806 15:55:04.549485 (+ 37us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:55:05.142994 (+593509us) tablet_service.cc:3304] Waiting for operations to commit
0806 15:55:05.836676 (+693682us) tablet_service.cc:3320] All operations in snapshot committed. Waited for 1287176 microseconds
0806 15:55:05.836761 (+ 85us) tablet_service.cc:2945] Iterator created
0806 15:55:05.837091 (+ 330us) tablet_service.cc:2967] Iterator init: OK
0806 15:55:05.837112 (+ 21us) tablet_service.cc:3010] has_more: true
0806 15:55:05.837138 (+ 26us) tablet_service.cc:3027] Continuing scan request
0806 15:55:05.837208 (+ 70us) tablet_service.cc:3091] Found scanner 4f103d9f7cd74df093d7a9623199b3cd for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 9675d01380214ae5b2ce5aee3941a353
0806 15:55:05.837593 (+ 385us) inbound_call.cc:173] Queueing success response
Metrics: {"rowset_iterators":1,"scanner_bytes_read":0,"spinlock_wait_cycles":52224}
I20260806 15:55:05.837692 13714 rpcz_store.cc:276] 0806 15:55:04.548901 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:04.549029 (+ 128us) service_pool.cc:227] Handling call
0806 15:55:04.549269 (+ 240us) tablet_service.cc:2780] Created scanner 2d1de8f5f8e24a82ba98aebd26be7995 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is d21e066cf7d040fe87c3e6e209703b30
0806 15:55:04.549444 (+ 175us) tablet_service.cc:2920] Creating iterator
0806 15:55:04.549485 (+ 41us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:55:05.142994 (+593509us) tablet_service.cc:3304] Waiting for operations to commit
0806 15:55:05.836645 (+693651us) tablet_service.cc:3320] All operations in snapshot committed. Waited for 1287150 microseconds
0806 15:55:05.836740 (+ 95us) tablet_service.cc:2945] Iterator created
0806 15:55:05.837081 (+ 341us) tablet_service.cc:2967] Iterator init: OK
0806 15:55:05.837105 (+ 24us) tablet_service.cc:3010] has_more: true
0806 15:55:05.837139 (+ 34us) tablet_service.cc:3027] Continuing scan request
0806 15:55:05.837195 (+ 56us) tablet_service.cc:3091] Found scanner 2d1de8f5f8e24a82ba98aebd26be7995 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is d21e066cf7d040fe87c3e6e209703b30
0806 15:55:05.837578 (+ 383us) inbound_call.cc:173] Queueing success response
Metrics: {"rowset_iterators":1,"scanner_bytes_read":0,"spinlock_wait_cycles":57472}
W20260806 15:55:05.838238 13994 scanner-internal.cc:458] Time spent opening tablet: real 1.290s user 0.001s sys 0.000s
W20260806 15:55:05.838299 13995 scanner-internal.cc:458] Time spent opening tablet: real 1.290s user 0.001s sys 0.000s
I20260806 15:55:05.900386 14027 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:06.192471 14026 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:06.192627 14026 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:06.193212 14026 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:06.193722 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:06.194398 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:06.194823 13831 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:06.795967 14026 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:06.946034 14026 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:06.946218 14026 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:06.946807 14026 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:06.947264 13614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:06.947342 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:06.947840 13829 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:06.958563 14026 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:06.959177 14057 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=9, attempt_no=0}) took 1120 ms. Trace:
W20260806 15:55:06.959420 13994 scanner-internal.cc:458] Time spent opening tablet: real 0.971s user 0.001s sys 0.000s
W20260806 15:55:06.959489 13995 scanner-internal.cc:458] Time spent opening tablet: real 0.971s user 0.001s sys 0.000s
I20260806 15:55:06.959300 14057 rpcz_store.cc:276] 0806 15:55:05.838623 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:05.838695 (+ 72us) service_pool.cc:227] Handling call
0806 15:55:06.959161 (+1120466us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:05.839135 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:05.839208 (+ 73us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:05.839210 (+ 2us) write_op.cc:435] Acquired schema lock
0806 15:55:05.839211 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:05.839265 (+ 54us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:05.839271 (+ 6us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:05.839273 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:05.839301 (+ 28us) tablet.cc:699] Row locks acquired
0806 15:55:05.839301 (+ 0us) write_op.cc:260] PREPARE: finished
0806 15:55:05.839325 (+ 24us) write_op.cc:270] Start()
0806 15:55:06.471458 (+632133us) write_op.cc:276] Timestamp: P: 1786031705839306 usec, L: 0
0806 15:55:06.471461 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:55:06.471696 (+ 235us) log.cc:842] Serialized 354 byte log entry
0806 15:55:06.957416 (+485720us) op_driver.cc:444] REPLICATION: finished
0806 15:55:06.957664 (+ 248us) write_op.cc:301] APPLY: starting
0806 15:55:06.957681 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:06.957706 (+ 25us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:06.957720 (+ 14us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:06.957771 (+ 51us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:06.957793 (+ 22us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:06.957796 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:06.957853 (+ 57us) log.cc:842] Serialized 22 byte log entry
0806 15:55:06.959075 (+ 1222us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:06.959086 (+ 11us) write_op.cc:454] Released schema lock
0806 15:55:06.959091 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":178,"num_ops":1,"prepare.queue_time_us":40,"prepare.run_cpu_time_us":555,"prepare.run_wall_time_us":632625,"replication_time_us":485925,"thread_start_us":96,"threads_started":1}]]}
I20260806 15:55:06.980334 14057 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=10, attempt_no=0}) took 1060 ms. Trace:
I20260806 15:55:06.980456 14057 rpcz_store.cc:276] 0806 15:55:05.920099 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:05.920161 (+ 62us) service_pool.cc:227] Handling call
0806 15:55:06.980318 (+1060157us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:06.471795 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:06.471943 (+ 148us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:06.471951 (+ 8us) write_op.cc:435] Acquired schema lock
0806 15:55:06.471954 (+ 3us) tablet.cc:660] Decoding operations
0806 15:55:06.472037 (+ 83us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:06.472044 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:06.472046 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:06.472082 (+ 36us) tablet.cc:699] Row locks acquired
0806 15:55:06.472083 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:06.472124 (+ 41us) write_op.cc:270] Start()
0806 15:55:06.865273 (+393149us) write_op.cc:276] Timestamp: P: 1786031706472090 usec, L: 0
0806 15:55:06.865277 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:06.865485 (+ 208us) log.cc:842] Serialized 354 byte log entry
0806 15:55:06.979822 (+114337us) op_driver.cc:444] REPLICATION: finished
0806 15:55:06.979935 (+ 113us) write_op.cc:301] APPLY: starting
0806 15:55:06.979974 (+ 39us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:06.980005 (+ 31us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:06.980018 (+ 13us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:06.980067 (+ 49us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:06.980091 (+ 24us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:06.980094 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:06.980156 (+ 62us) log.cc:842] Serialized 22 byte log entry
0806 15:55:06.980229 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:06.980241 (+ 12us) write_op.cc:454] Released schema lock
0806 15:55:06.980246 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":36,"num_ops":1,"prepare.queue_time_us":551308,"prepare.run_cpu_time_us":689,"prepare.run_wall_time_us":393750,"replication_time_us":114520}]]}
I20260806 15:55:07.098466 14052 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:07.098608 14052 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:07.099207 14052 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:07.099470 13896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:07.099635 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:07.100230 13543 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:07.752140 14052 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:07.932979 14052 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:07.933146 14052 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:07.933633 14052 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:07.933960 13896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:07.934178 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:07.934528 13543 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:07.934686 14052 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:08.205972 14065 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:08.206238 14065 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:08.207147 14065 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:08.207245 13614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:08.207482 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:08.207994 13829 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:08.208141 14065 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:08.237571 14068 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=12, attempt_no=0}) took 1255 ms. Trace:
W20260806 15:55:08.237849 13994 scanner-internal.cc:458] Time spent opening tablet: real 0.714s user 0.001s sys 0.000s
I20260806 15:55:08.237696 14068 rpcz_store.cc:276] 0806 15:55:06.981696 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:06.981754 (+ 58us) service_pool.cc:227] Handling call
0806 15:55:08.237551 (+1255797us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:07.321720 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:07.321805 (+ 85us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:07.321809 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:07.321810 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:07.321902 (+ 92us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:07.321941 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:07.321944 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:07.321993 (+ 49us) tablet.cc:699] Row locks acquired
0806 15:55:07.321996 (+ 3us) write_op.cc:260] PREPARE: finished
0806 15:55:07.322037 (+ 41us) write_op.cc:270] Start()
0806 15:55:08.028169 (+706132us) write_op.cc:276] Timestamp: P: 1786031707321978 usec, L: 0
0806 15:55:08.028173 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:08.028408 (+ 235us) log.cc:842] Serialized 354 byte log entry
0806 15:55:08.236015 (+207607us) op_driver.cc:444] REPLICATION: finished
0806 15:55:08.236320 (+ 305us) write_op.cc:301] APPLY: starting
0806 15:55:08.236341 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:08.236371 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:08.236389 (+ 18us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:08.236457 (+ 68us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:08.236491 (+ 34us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:08.236497 (+ 6us) write_op.cc:312] APPLY: finished
0806 15:55:08.236570 (+ 73us) log.cc:842] Serialized 22 byte log entry
0806 15:55:08.237457 (+ 887us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:08.237468 (+ 11us) write_op.cc:454] Released schema lock
0806 15:55:08.237472 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":246,"num_ops":1,"prepare.queue_time_us":339681,"prepare.run_cpu_time_us":845,"prepare.run_wall_time_us":706902,"raft.queue_time_us":162,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":179,"replication_time_us":207814,"thread_start_us":231,"threads_started":2}]]}
W20260806 15:55:08.237910 13995 scanner-internal.cc:458] Time spent opening tablet: real 0.714s user 0.001s sys 0.000s
I20260806 15:55:08.582859 14065 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:08.582999 14065 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:08.583513 14065 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:08.583928 13614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:08.583945 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:08.584456 13829 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:08.584700 14065 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:08.595238 14068 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=13, attempt_no=0}) took 1221 ms. Trace:
I20260806 15:55:08.595324 14068 rpcz_store.cc:276] 0806 15:55:07.373276 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:07.373318 (+ 42us) service_pool.cc:227] Handling call
0806 15:55:08.595224 (+1221906us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:08.028649 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:08.028755 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:08.028759 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:08.028761 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:08.028859 (+ 98us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:08.028869 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:08.028871 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:08.028916 (+ 45us) tablet.cc:699] Row locks acquired
0806 15:55:08.028919 (+ 3us) write_op.cc:260] PREPARE: finished
0806 15:55:08.028959 (+ 40us) write_op.cc:270] Start()
0806 15:55:08.574118 (+545159us) write_op.cc:276] Timestamp: P: 1786031708028921 usec, L: 0
0806 15:55:08.574123 (+ 5us) op_driver.cc:331] REPLICATION: starting
0806 15:55:08.574362 (+ 239us) log.cc:842] Serialized 354 byte log entry
0806 15:55:08.594646 (+ 20284us) op_driver.cc:444] REPLICATION: finished
0806 15:55:08.594805 (+ 159us) write_op.cc:301] APPLY: starting
0806 15:55:08.594823 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:08.594852 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:08.594867 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:08.594948 (+ 81us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:08.594980 (+ 32us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:08.594984 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:55:08.595052 (+ 68us) log.cc:842] Serialized 22 byte log entry
0806 15:55:08.595147 (+ 95us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:08.595157 (+ 10us) write_op.cc:454] Released schema lock
0806 15:55:08.595163 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":76,"num_ops":1,"prepare.queue_time_us":654977,"prepare.run_cpu_time_us":709,"prepare.run_wall_time_us":545765,"replication_time_us":20498}]]}
I20260806 15:55:08.774890 14052 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:08.775076 14052 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:08.775585 14052 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:08.776114 13896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:08.776165 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:08.776780 13543 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:08.823309 14052 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:09.713677 14071 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:09.713840 14071 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:09.714468 14071 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:09.714910 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:09.714998 13894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:09.715442 13544 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:09.715731 14071 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:09.721599 14075 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=14, attempt_no=0}) took 1482 ms. Trace:
W20260806 15:55:09.721894 13995 scanner-internal.cc:458] Time spent opening tablet: real 0.975s user 0.001s sys 0.000s
W20260806 15:55:09.721917 13994 scanner-internal.cc:458] Time spent opening tablet: real 0.975s user 0.001s sys 0.000s
I20260806 15:55:09.721688 14075 rpcz_store.cc:276] 0806 15:55:08.238882 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:08.238965 (+ 83us) service_pool.cc:227] Handling call
0806 15:55:09.721588 (+1482623us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:08.574460 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:08.574578 (+ 118us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:08.574582 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:08.574584 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:08.574687 (+ 103us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:08.574696 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:08.574699 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:08.574743 (+ 44us) tablet.cc:699] Row locks acquired
0806 15:55:08.574744 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:08.574780 (+ 36us) write_op.cc:270] Start()
0806 15:55:09.567905 (+993125us) write_op.cc:276] Timestamp: P: 1786031708574740 usec, L: 0
0806 15:55:09.567910 (+ 5us) op_driver.cc:331] REPLICATION: starting
0806 15:55:09.568177 (+ 267us) log.cc:842] Serialized 354 byte log entry
0806 15:55:09.719998 (+151821us) op_driver.cc:444] REPLICATION: finished
0806 15:55:09.720211 (+ 213us) write_op.cc:301] APPLY: starting
0806 15:55:09.720223 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:09.720251 (+ 28us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:09.720268 (+ 17us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:09.720423 (+ 155us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:09.720449 (+ 26us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:09.720453 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:55:09.720510 (+ 57us) log.cc:842] Serialized 22 byte log entry
0806 15:55:09.721504 (+ 994us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:09.721515 (+ 11us) write_op.cc:454] Released schema lock
0806 15:55:09.721520 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":156,"num_ops":1,"prepare.queue_time_us":335162,"prepare.run_cpu_time_us":752,"prepare.run_wall_time_us":993810,"raft.queue_time_us":106,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":3,"replication_time_us":152063,"spinlock_wait_cycles":2944,"thread_start_us":69,"threads_started":1}]]}
I20260806 15:55:10.543219 14072 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:10.543375 14072 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:10.543998 14072 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:10.544430 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:10.544442 13614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:10.545245 13829 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:10.648813 14072 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:10.685736 14081 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=15, attempt_no=0}) took 2088 ms. Trace:
I20260806 15:55:10.685851 14081 rpcz_store.cc:276] 0806 15:55:08.596974 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:08.597032 (+ 58us) service_pool.cc:227] Handling call
0806 15:55:10.685716 (+2088684us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:09.568293 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:09.568427 (+ 134us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:09.568434 (+ 7us) write_op.cc:435] Acquired schema lock
0806 15:55:09.568438 (+ 4us) tablet.cc:660] Decoding operations
0806 15:55:09.568536 (+ 98us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:09.568544 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:09.568547 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:09.568591 (+ 44us) tablet.cc:699] Row locks acquired
0806 15:55:09.568593 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:55:09.568627 (+ 34us) write_op.cc:270] Start()
0806 15:55:10.466786 (+898159us) write_op.cc:276] Timestamp: P: 1786031709568599 usec, L: 0
0806 15:55:10.466789 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:55:10.466993 (+ 204us) log.cc:842] Serialized 354 byte log entry
0806 15:55:10.685003 (+218010us) op_driver.cc:444] REPLICATION: finished
0806 15:55:10.685278 (+ 275us) write_op.cc:301] APPLY: starting
0806 15:55:10.685303 (+ 25us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:10.685328 (+ 25us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:10.685341 (+ 13us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:10.685393 (+ 52us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:10.685418 (+ 25us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:10.685421 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:10.685515 (+ 94us) log.cc:842] Serialized 22 byte log entry
0806 15:55:10.685616 (+ 101us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:10.685629 (+ 13us) write_op.cc:454] Released schema lock
0806 15:55:10.685634 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":212,"num_ops":1,"prepare.queue_time_us":970938,"prepare.run_cpu_time_us":727,"prepare.run_wall_time_us":898802,"raft.queue_time_us":44,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":150,"replication_time_us":218185,"thread_start_us":105,"threads_started":1}]]}
W20260806 15:55:10.687161 13994 scanner-internal.cc:458] Time spent opening tablet: real 0.815s user 0.001s sys 0.000s
W20260806 15:55:10.687561 13995 scanner-internal.cc:458] Time spent opening tablet: real 0.815s user 0.000s sys 0.001s
I20260806 15:55:11.033915 14076 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:11.034124 14076 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:11.034737 14076 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:11.035151 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:11.035166 13894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:11.035773 13543 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:11.078755 14076 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:11.091523 14081 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=16, attempt_no=0}) took 1368 ms. Trace:
I20260806 15:55:11.091652 14081 rpcz_store.cc:276] 0806 15:55:09.723004 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:09.723064 (+ 60us) service_pool.cc:227] Handling call
0806 15:55:11.091505 (+1368441us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:10.467120 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:10.467207 (+ 87us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:10.467210 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:55:10.467211 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:10.467304 (+ 93us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:10.467313 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:10.467316 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:10.467361 (+ 45us) tablet.cc:699] Row locks acquired
0806 15:55:10.467365 (+ 4us) write_op.cc:260] PREPARE: finished
0806 15:55:10.467403 (+ 38us) write_op.cc:270] Start()
0806 15:55:10.890562 (+423159us) write_op.cc:276] Timestamp: P: 1786031710467381 usec, L: 0
0806 15:55:10.890565 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:55:10.890800 (+ 235us) log.cc:842] Serialized 354 byte log entry
0806 15:55:11.090942 (+200142us) op_driver.cc:444] REPLICATION: finished
0806 15:55:11.091061 (+ 119us) write_op.cc:301] APPLY: starting
0806 15:55:11.091081 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:11.091112 (+ 31us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:11.091131 (+ 19us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:11.091210 (+ 79us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:11.091239 (+ 29us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:11.091242 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:11.091308 (+ 66us) log.cc:842] Serialized 22 byte log entry
0806 15:55:11.091383 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:11.091418 (+ 35us) write_op.cc:454] Released schema lock
0806 15:55:11.091424 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":62,"num_ops":1,"prepare.queue_time_us":743743,"prepare.run_cpu_time_us":697,"prepare.run_wall_time_us":423768,"raft.queue_time_us":36,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":175,"replication_time_us":200347,"spinlock_wait_cycles":25984}]]}
I20260806 15:55:11.380105 14076 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:11.380263 14076 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:11.380834 14076 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:11.381261 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 19 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:11.381261 13894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 19 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:11.381812 13543 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:11.382014 14076 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:11.828438 14072 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:11.828581 14072 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:11.829092 14072 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:11.829468 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 18 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:11.829525 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 18 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:11.830015 13831 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:12.592433 14076 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:12.592631 14076 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:12.593204 14076 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:12.593611 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 20 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:12.593623 13894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 20 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:12.594146 13544 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:12.622637 14094 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=18, attempt_no=0}) took 1529 ms. Trace:
I20260806 15:55:12.622762 14094 rpcz_store.cc:276] 0806 15:55:11.093428 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:11.093625 (+ 197us) service_pool.cc:227] Handling call
0806 15:55:12.622615 (+1528990us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:11.241735 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:11.241861 (+ 126us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:11.241866 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:55:11.241868 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:11.241991 (+ 123us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:11.242000 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:11.242004 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:11.242048 (+ 44us) tablet.cc:699] Row locks acquired
0806 15:55:11.242050 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:55:11.242138 (+ 88us) write_op.cc:270] Start()
0806 15:55:11.866311 (+624173us) write_op.cc:276] Timestamp: P: 1786031711242092 usec, L: 0
0806 15:55:11.866315 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:11.866625 (+ 310us) log.cc:842] Serialized 354 byte log entry
0806 15:55:12.621791 (+755166us) op_driver.cc:444] REPLICATION: finished
0806 15:55:12.622163 (+ 372us) write_op.cc:301] APPLY: starting
0806 15:55:12.622182 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:12.622210 (+ 28us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:12.622227 (+ 17us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:12.622289 (+ 62us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:12.622315 (+ 26us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:12.622318 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:12.622386 (+ 68us) log.cc:842] Serialized 22 byte log entry
0806 15:55:12.622505 (+ 119us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:12.622519 (+ 14us) write_op.cc:454] Released schema lock
0806 15:55:12.622525 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":298,"num_ops":1,"prepare.queue_time_us":147760,"prepare.run_cpu_time_us":869,"prepare.run_wall_time_us":624953,"replication_time_us":755429,"thread_start_us":137,"threads_started":1}]]}
I20260806 15:55:12.623469 13715 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:36064 (request call id 44) took 1379 ms. Trace:
I20260806 15:55:12.623469 13714 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:36064 (request call id 43) took 1379 ms. Trace:
I20260806 15:55:12.623615 13715 rpcz_store.cc:276] 0806 15:55:11.244122 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:11.244195 (+ 73us) service_pool.cc:227] Handling call
0806 15:55:11.244334 (+ 139us) tablet_service.cc:2780] Created scanner c53980c45a50495f80bb99ccdc48dee3 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 81b84bb4bcc14b4b83e488249e51515c
0806 15:55:11.244476 (+ 142us) tablet_service.cc:2920] Creating iterator
0806 15:55:11.244494 (+ 18us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:55:11.866515 (+622021us) tablet_service.cc:3304] Waiting for operations to commit
0806 15:55:12.622556 (+756041us) tablet_service.cc:3320] All operations in snapshot committed. Waited for 1378046 microseconds
0806 15:55:12.622654 (+ 98us) tablet_service.cc:2945] Iterator created
0806 15:55:12.622976 (+ 322us) tablet_service.cc:2967] Iterator init: OK
0806 15:55:12.623000 (+ 24us) tablet_service.cc:3010] has_more: true
0806 15:55:12.623036 (+ 36us) tablet_service.cc:3027] Continuing scan request
0806 15:55:12.623090 (+ 54us) tablet_service.cc:3091] Found scanner c53980c45a50495f80bb99ccdc48dee3 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 81b84bb4bcc14b4b83e488249e51515c
0806 15:55:12.623459 (+ 369us) inbound_call.cc:173] Queueing success response
Metrics: {"rowset_iterators":1,"scanner_bytes_read":0,"spinlock_wait_cycles":37632}
I20260806 15:55:12.623675 13714 rpcz_store.cc:276] 0806 15:55:11.244023 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:11.244083 (+ 60us) service_pool.cc:227] Handling call
0806 15:55:11.244242 (+ 159us) tablet_service.cc:2780] Created scanner ce76b34e5cbc44d1bd29a22102cb15f2 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is e0a8fc99e7f04092a665e8feed22fe5c
0806 15:55:11.244408 (+ 166us) tablet_service.cc:2920] Creating iterator
0806 15:55:11.244433 (+ 25us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:55:11.866477 (+622044us) tablet_service.cc:3304] Waiting for operations to commit
0806 15:55:12.622556 (+756079us) tablet_service.cc:3320] All operations in snapshot committed. Waited for 1378107 microseconds
0806 15:55:12.622654 (+ 98us) tablet_service.cc:2945] Iterator created
0806 15:55:12.622976 (+ 322us) tablet_service.cc:2967] Iterator init: OK
0806 15:55:12.623003 (+ 27us) tablet_service.cc:3010] has_more: true
0806 15:55:12.623042 (+ 39us) tablet_service.cc:3027] Continuing scan request
0806 15:55:12.623090 (+ 48us) tablet_service.cc:3091] Found scanner ce76b34e5cbc44d1bd29a22102cb15f2 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is e0a8fc99e7f04092a665e8feed22fe5c
0806 15:55:12.623459 (+ 369us) inbound_call.cc:173] Queueing success response
Metrics: {"rowset_iterators":1,"scanner_bytes_read":0,"spinlock_wait_cycles":30336}
W20260806 15:55:12.624358 13994 scanner-internal.cc:458] Time spent opening tablet: real 1.381s user 0.000s sys 0.000s
W20260806 15:55:12.624372 13995 scanner-internal.cc:458] Time spent opening tablet: real 1.381s user 0.000s sys 0.000s
I20260806 15:55:12.753539 14072 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:12.938370 14076 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:12.961987 14094 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=19, attempt_no=0}) took 1530 ms. Trace:
I20260806 15:55:12.962111 14094 rpcz_store.cc:276] 0806 15:55:11.431226 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:11.431271 (+ 45us) service_pool.cc:227] Handling call
0806 15:55:12.961968 (+1530697us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:11.866728 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:11.866879 (+ 151us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:11.866885 (+ 6us) write_op.cc:435] Acquired schema lock
0806 15:55:11.866887 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:11.866974 (+ 87us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:11.866983 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:11.866986 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:11.867033 (+ 47us) tablet.cc:699] Row locks acquired
0806 15:55:11.867034 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:11.867065 (+ 31us) write_op.cc:270] Start()
0806 15:55:12.157251 (+290186us) write_op.cc:276] Timestamp: P: 1786031711867000 usec, L: 0
0806 15:55:12.157255 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:12.157465 (+ 210us) log.cc:842] Serialized 354 byte log entry
0806 15:55:12.961467 (+804002us) op_driver.cc:444] REPLICATION: finished
0806 15:55:12.961596 (+ 129us) write_op.cc:301] APPLY: starting
0806 15:55:12.961617 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:12.961650 (+ 33us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:12.961668 (+ 18us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:12.961734 (+ 66us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:12.961762 (+ 28us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:12.961765 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:12.961829 (+ 64us) log.cc:842] Serialized 22 byte log entry
0806 15:55:12.961893 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:12.961904 (+ 11us) write_op.cc:454] Released schema lock
0806 15:55:12.961908 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":57,"num_ops":1,"prepare.queue_time_us":435026,"prepare.run_cpu_time_us":712,"prepare.run_wall_time_us":290800,"replication_time_us":804161}]]}
I20260806 15:55:13.111896 14076 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:13.112080 14076 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:13.112635 14076 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:13.113082 13894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 22 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:13.113082 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 22 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:13.113554 13543 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:13.263522 14076 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:13.651521 14072 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:13.651656 14072 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:13.652230 14072 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:13.652650 13614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 21 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:13.652958 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 21 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:13.653576 13829 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:14.241977 14076 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:14.242156 14076 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:14.242648 14076 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:14.243083 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 24 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:14.243110 13894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 24 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:14.243688 13543 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:14.244839 14104 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=22, attempt_no=0}) took 1112 ms. Trace:
I20260806 15:55:14.244917 14104 rpcz_store.cc:276] 0806 15:55:13.132030 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:13.132212 (+ 182us) service_pool.cc:227] Handling call
0806 15:55:14.244824 (+1112612us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:13.132628 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:13.132691 (+ 63us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:13.132694 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:55:13.132695 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:13.132747 (+ 52us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:13.132753 (+ 6us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:13.132755 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:13.132783 (+ 28us) tablet.cc:699] Row locks acquired
0806 15:55:13.132784 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:13.132809 (+ 25us) write_op.cc:270] Start()
0806 15:55:13.162962 (+ 30153us) write_op.cc:276] Timestamp: P: 1786031713132774 usec, L: 0
0806 15:55:13.162967 (+ 5us) op_driver.cc:331] REPLICATION: starting
0806 15:55:13.163172 (+ 205us) log.cc:842] Serialized 354 byte log entry
0806 15:55:14.244258 (+1081086us) op_driver.cc:444] REPLICATION: finished
0806 15:55:14.244491 (+ 233us) write_op.cc:301] APPLY: starting
0806 15:55:14.244510 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:14.244530 (+ 20us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:14.244542 (+ 12us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:14.244584 (+ 42us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:14.244604 (+ 20us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:14.244606 (+ 2us) write_op.cc:312] APPLY: finished
0806 15:55:14.244652 (+ 46us) log.cc:842] Serialized 22 byte log entry
0806 15:55:14.244745 (+ 93us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:14.244755 (+ 10us) write_op.cc:454] Released schema lock
0806 15:55:14.244760 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":178,"num_ops":1,"prepare.queue_time_us":42,"prepare.run_cpu_time_us":538,"prepare.run_wall_time_us":30607,"replication_time_us":1081267,"thread_start_us":85,"threads_started":1}]]}
W20260806 15:55:14.246156 13995 scanner-internal.cc:458] Time spent opening tablet: real 0.963s user 0.001s sys 0.000s
W20260806 15:55:14.246179 13994 scanner-internal.cc:458] Time spent opening tablet: real 0.964s user 0.001s sys 0.000s
I20260806 15:55:14.919668 14076 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:14.951635 14111 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=23, attempt_no=0}) took 1638 ms. Trace:
I20260806 15:55:14.951728 14111 rpcz_store.cc:276] 0806 15:55:13.313496 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:13.313556 (+ 60us) service_pool.cc:227] Handling call
0806 15:55:14.951616 (+1638060us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:13.314199 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:13.314294 (+ 95us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:13.314297 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:55:13.314298 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:13.314360 (+ 62us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:13.314367 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:13.314374 (+ 7us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:13.314407 (+ 33us) tablet.cc:699] Row locks acquired
0806 15:55:13.314408 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:13.314439 (+ 31us) write_op.cc:270] Start()
0806 15:55:13.816631 (+502192us) write_op.cc:276] Timestamp: P: 1786031713314385 usec, L: 0
0806 15:55:13.816636 (+ 5us) op_driver.cc:331] REPLICATION: starting
0806 15:55:13.816860 (+ 224us) log.cc:842] Serialized 354 byte log entry
0806 15:55:14.950908 (+1134048us) op_driver.cc:444] REPLICATION: finished
0806 15:55:14.951182 (+ 274us) write_op.cc:301] APPLY: starting
0806 15:55:14.951198 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:14.951244 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:14.951268 (+ 24us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:14.951340 (+ 72us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:14.951371 (+ 31us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:14.951375 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:55:14.951475 (+ 100us) log.cc:842] Serialized 22 byte log entry
0806 15:55:14.951531 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:14.951541 (+ 10us) write_op.cc:454] Released schema lock
0806 15:55:14.951546 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":213,"num_ops":1,"prepare.queue_time_us":137,"prepare.run_cpu_time_us":657,"prepare.run_wall_time_us":502725,"replication_time_us":1134237,"thread_start_us":91,"threads_started":1}]]}
I20260806 15:55:15.390276 14076 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:15.390444 14076 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:15.391121 14076 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:15.391547 13894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:15.391700 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:15.392150 13543 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:15.392300 14076 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:15.400892 14111 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=24, attempt_no=0}) took 1154 ms. Trace:
I20260806 15:55:15.400981 14111 rpcz_store.cc:276] 0806 15:55:14.246630 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:14.246679 (+ 49us) service_pool.cc:227] Handling call
0806 15:55:15.400877 (+1154198us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:14.247018 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:14.247080 (+ 62us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:14.247083 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:55:14.247084 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:14.247144 (+ 60us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:14.247149 (+ 5us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:14.247151 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:14.247176 (+ 25us) tablet.cc:699] Row locks acquired
0806 15:55:14.247176 (+ 0us) write_op.cc:260] PREPARE: finished
0806 15:55:14.247201 (+ 25us) write_op.cc:270] Start()
0806 15:55:14.252331 (+ 5130us) write_op.cc:276] Timestamp: P: 1786031714247170 usec, L: 0
0806 15:55:14.252335 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:14.252486 (+ 151us) log.cc:842] Serialized 354 byte log entry
0806 15:55:15.400390 (+1147904us) op_driver.cc:444] REPLICATION: finished
0806 15:55:15.400484 (+ 94us) write_op.cc:301] APPLY: starting
0806 15:55:15.400502 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:15.400530 (+ 28us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:15.400546 (+ 16us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:15.400604 (+ 58us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:15.400628 (+ 24us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:15.400631 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:15.400686 (+ 55us) log.cc:842] Serialized 22 byte log entry
0806 15:55:15.400779 (+ 93us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:15.400789 (+ 10us) write_op.cc:454] Released schema lock
0806 15:55:15.400810 (+ 21us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":45,"num_ops":1,"prepare.queue_time_us":70,"prepare.run_cpu_time_us":447,"prepare.run_wall_time_us":5523,"replication_time_us":1148030}]]}
I20260806 15:55:15.401768 13715 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:36064 (request call id 56) took 1004 ms. Trace:
I20260806 15:55:15.401791 13714 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:36064 (request call id 55) took 1004 ms. Trace:
I20260806 15:55:15.401875 13715 rpcz_store.cc:276] 0806 15:55:14.397476 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:14.397556 (+ 80us) service_pool.cc:227] Handling call
0806 15:55:14.397698 (+ 142us) tablet_service.cc:2780] Created scanner c50bcca453434af3b61da8e4e641b791 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is d15fbf48089c4c83824dbbdf5bc59d51
0806 15:55:14.397843 (+ 145us) tablet_service.cc:2920] Creating iterator
0806 15:55:14.397868 (+ 25us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:55:14.397874 (+ 6us) tablet_service.cc:3304] Waiting for operations to commit
0806 15:55:15.400797 (+1002923us) tablet_service.cc:3320] All operations in snapshot committed. Waited for 1002917 microseconds
0806 15:55:15.400891 (+ 94us) tablet_service.cc:2945] Iterator created
0806 15:55:15.401274 (+ 383us) tablet_service.cc:2967] Iterator init: OK
0806 15:55:15.401298 (+ 24us) tablet_service.cc:3010] has_more: true
0806 15:55:15.401329 (+ 31us) tablet_service.cc:3027] Continuing scan request
0806 15:55:15.401382 (+ 53us) tablet_service.cc:3091] Found scanner c50bcca453434af3b61da8e4e641b791 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is d15fbf48089c4c83824dbbdf5bc59d51
0806 15:55:15.401757 (+ 375us) inbound_call.cc:173] Queueing success response
Metrics: {"rowset_iterators":1,"scanner_bytes_read":0}
I20260806 15:55:15.401921 13714 rpcz_store.cc:276] 0806 15:55:14.397410 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:14.397496 (+ 86us) service_pool.cc:227] Handling call
0806 15:55:14.397663 (+ 167us) tablet_service.cc:2780] Created scanner 13cce559d5dc4b9c9e4385812084ce31 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is f6818ca2bd6348108f823a14096b2418
0806 15:55:14.397869 (+ 206us) tablet_service.cc:2920] Creating iterator
0806 15:55:14.397895 (+ 26us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:55:14.397903 (+ 8us) tablet_service.cc:3304] Waiting for operations to commit
0806 15:55:15.400840 (+1002937us) tablet_service.cc:3320] All operations in snapshot committed. Waited for 1002930 microseconds
0806 15:55:15.400925 (+ 85us) tablet_service.cc:2945] Iterator created
0806 15:55:15.401311 (+ 386us) tablet_service.cc:2967] Iterator init: OK
0806 15:55:15.401337 (+ 26us) tablet_service.cc:3010] has_more: true
0806 15:55:15.401379 (+ 42us) tablet_service.cc:3027] Continuing scan request
0806 15:55:15.401423 (+ 44us) tablet_service.cc:3091] Found scanner 13cce559d5dc4b9c9e4385812084ce31 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is f6818ca2bd6348108f823a14096b2418
0806 15:55:15.401779 (+ 356us) inbound_call.cc:173] Queueing success response
Metrics: {"rowset_iterators":1,"scanner_bytes_read":0}
W20260806 15:55:15.402513 13994 scanner-internal.cc:458] Time spent opening tablet: real 1.006s user 0.001s sys 0.000s
W20260806 15:55:15.402769 13995 scanner-internal.cc:458] Time spent opening tablet: real 1.006s user 0.001s sys 0.000s
I20260806 15:55:15.617705 14072 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:15.618502 13896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.189.194:44759 (request call id 2031) took 1965 ms. Trace:
I20260806 15:55:15.618606 13896 rpcz_store.cc:276] 0806 15:55:13.652821 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:13.652868 (+ 47us) service_pool.cc:227] Handling call
0806 15:55:13.653036 (+ 168us) raft_consensus.cc:1457] Updating replica for 3 ops
0806 15:55:13.653291 (+ 255us) raft_consensus.cc:1520] Early marking committed up to index 21
0806 15:55:13.653360 (+ 69us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0806 15:55:13.653502 (+ 142us) write_op.cc:270] Start()
0806 15:55:14.323702 (+670200us) write_op.cc:276] Timestamp: P: 1786031712625043 usec, L: 0
0806 15:55:14.324115 (+ 413us) write_op.cc:270] Start()
0806 15:55:14.721279 (+397164us) write_op.cc:276] Timestamp: P: 1786031713008933 usec, L: 0
0806 15:55:14.721566 (+ 287us) write_op.cc:270] Start()
0806 15:55:15.616753 (+895187us) write_op.cc:276] Timestamp: P: 1786031713132774 usec, L: 0
0806 15:55:15.617273 (+ 520us) log.cc:842] Serialized 1062 byte log entry
0806 15:55:15.617390 (+ 117us) raft_consensus.cc:1631] Marking committed up to 23
0806 15:55:15.617640 (+ 250us) raft_consensus.cc:1683] Filling consensus response to leader.
0806 15:55:15.617665 (+ 25us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0806 15:55:15.618434 (+ 769us) raft_consensus.cc:1671] finished
0806 15:55:15.618436 (+ 2us) raft_consensus.cc:1677] UpdateReplicas() finished
0806 15:55:15.618487 (+ 51us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:14.324112 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:14.324213 (+ 101us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:14.324216 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:55:14.324218 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:14.324286 (+ 68us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:14.324295 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:14.324297 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:14.324339 (+ 42us) tablet.cc:699] Row locks acquired
0806 15:55:14.324340 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:15.617417 (+1293077us) op_driver.cc:444] REPLICATION: finished
0806 15:55:15.617603 (+ 186us) write_op.cc:301] APPLY: starting
0806 15:55:15.617618 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:15.617649 (+ 31us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:15.617650 (+ 1us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:15.617704 (+ 54us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:15.617742 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:15.617766 (+ 24us) write_op.cc:312] APPLY: finished
0806 15:55:15.617822 (+ 56us) log.cc:842] Serialized 22 byte log entry
0806 15:55:15.617875 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:15.617888 (+ 13us) write_op.cc:454] Released schema lock
0806 15:55:15.617894 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0806 15:55:15.617964 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:15.617966 (+ 2us) write_op.cc:454] Released schema lock
Related trace 'op':
0806 15:55:14.721553 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:14.721669 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:14.721673 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:14.721675 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:14.721747 (+ 72us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:14.721757 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:14.721759 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:14.721794 (+ 35us) tablet.cc:699] Row locks acquired
0806 15:55:14.721795 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:15.617549 (+895754us) op_driver.cc:444] REPLICATION: finished
0806 15:55:15.617701 (+ 152us) write_op.cc:301] APPLY: starting
0806 15:55:15.617715 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:15.617739 (+ 24us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:15.617741 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:15.617788 (+ 47us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:15.617811 (+ 23us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:15.617827 (+ 16us) write_op.cc:312] APPLY: finished
0806 15:55:15.617916 (+ 89us) log.cc:842] Serialized 22 byte log entry
0806 15:55:15.617953 (+ 37us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:15.617964 (+ 11us) write_op.cc:454] Released schema lock
0806 15:55:15.617968 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0806 15:55:15.618025 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:15.618027 (+ 2us) write_op.cc:454] Released schema lock
Related trace 'op':
0806 15:55:15.617140 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:15.617247 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:15.617251 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:15.617253 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:15.617344 (+ 91us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:15.617359 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:15.617363 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:15.617409 (+ 46us) tablet.cc:699] Row locks acquired
0806 15:55:15.617411 (+ 2us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":64,"threads_started":1,"wal-append.queue_time_us":134,"child_traces":[["op",{"apply.queue_time_us":145,"apply.run_cpu_time_us":401,"apply.run_wall_time_us":400,"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":270,"prepare.run_cpu_time_us":353,"prepare.run_wall_time_us":353,"replication_time_us":1963903,"thread_start_us":203,"threads_started":2}],["op",{"apply.queue_time_us":110,"apply.run_cpu_time_us":319,"apply.run_wall_time_us":367,"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":65,"prepare.run_cpu_time_us":346,"prepare.run_wall_time_us":346,"replication_time_us":1293423,"thread_start_us":52,"threads_started":1}],["op",{"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":209,"prepare.run_cpu_time_us":323,"prepare.run_wall_time_us":322,"thread_start_us":101,"threads_started":1}]]}
I20260806 15:55:16.339944 14076 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:16.340101 14076 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:16.340723 14076 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:16.341181 13894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 27 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:16.341308 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 27 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:16.341674 13543 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:16.353020 14121 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=25, attempt_no=0}) took 1399 ms. Trace:
I20260806 15:55:16.353119 14121 rpcz_store.cc:276] 0806 15:55:14.953142 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:14.953230 (+ 88us) service_pool.cc:227] Handling call
0806 15:55:16.352993 (+1399763us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:14.953806 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:14.953892 (+ 86us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:14.953895 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:55:14.953896 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:14.953955 (+ 59us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:14.953961 (+ 6us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:14.953963 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:14.953992 (+ 29us) tablet.cc:699] Row locks acquired
0806 15:55:14.953993 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:14.954021 (+ 28us) write_op.cc:270] Start()
0806 15:55:15.792189 (+838168us) write_op.cc:276] Timestamp: P: 1786031714953960 usec, L: 0
0806 15:55:15.792193 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:15.792472 (+ 279us) log.cc:842] Serialized 354 byte log entry
0806 15:55:16.352211 (+559739us) op_driver.cc:444] REPLICATION: finished
0806 15:55:16.352480 (+ 269us) write_op.cc:301] APPLY: starting
0806 15:55:16.352495 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:16.352539 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:16.352553 (+ 14us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:16.352605 (+ 52us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:16.352628 (+ 23us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:16.352631 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:16.352689 (+ 58us) log.cc:842] Serialized 22 byte log entry
0806 15:55:16.352898 (+ 209us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:16.352911 (+ 13us) write_op.cc:454] Released schema lock
0806 15:55:16.352916 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":210,"num_ops":1,"prepare.queue_time_us":163,"prepare.run_cpu_time_us":635,"prepare.run_wall_time_us":838723,"replication_time_us":559988,"thread_start_us":167,"threads_started":2}]]}
W20260806 15:55:16.354262 13995 scanner-internal.cc:458] Time spent opening tablet: real 0.801s user 0.000s sys 0.000s
W20260806 15:55:16.354334 13994 scanner-internal.cc:458] Time spent opening tablet: real 0.801s user 0.001s sys 0.000s
I20260806 15:55:16.778720 14072 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:16.778849 14072 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:16.778981 13896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.189.194:44759 (request call id 2032) took 1158 ms. Trace:
I20260806 15:55:16.779057 13896 rpcz_store.cc:276] 0806 15:55:15.620663 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:15.620732 (+ 69us) service_pool.cc:227] Handling call
0806 15:55:15.620871 (+ 139us) raft_consensus.cc:1457] Updating replica for 2 ops
0806 15:55:15.620971 (+ 100us) raft_consensus.cc:1520] Early marking committed up to index 24
0806 15:55:15.621048 (+ 77us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0806 15:55:15.621150 (+ 102us) write_op.cc:270] Start()
0806 15:55:16.576312 (+955162us) write_op.cc:276] Timestamp: P: 1786031713314385 usec, L: 0
0806 15:55:16.576657 (+ 345us) write_op.cc:270] Start()
0806 15:55:16.777850 (+201193us) write_op.cc:276] Timestamp: P: 1786031714247170 usec, L: 0
0806 15:55:16.778234 (+ 384us) log.cc:842] Serialized 708 byte log entry
0806 15:55:16.778390 (+ 156us) raft_consensus.cc:1631] Marking committed up to 26
0806 15:55:16.778648 (+ 258us) raft_consensus.cc:1683] Filling consensus response to leader.
0806 15:55:16.778679 (+ 31us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0806 15:55:16.778923 (+ 244us) raft_consensus.cc:1671] finished
0806 15:55:16.778924 (+ 1us) raft_consensus.cc:1677] UpdateReplicas() finished
0806 15:55:16.778965 (+ 41us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:16.576651 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:16.576748 (+ 97us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:16.576752 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:16.576753 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:16.576821 (+ 68us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:16.576832 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:16.576833 (+ 1us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:16.576871 (+ 38us) tablet.cc:699] Row locks acquired
0806 15:55:16.576871 (+ 0us) write_op.cc:260] PREPARE: finished
0806 15:55:16.778432 (+201561us) op_driver.cc:444] REPLICATION: finished
0806 15:55:16.778621 (+ 189us) write_op.cc:301] APPLY: starting
0806 15:55:16.778637 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:16.778667 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:16.778671 (+ 4us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:16.778729 (+ 58us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:16.778760 (+ 31us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:16.778784 (+ 24us) write_op.cc:312] APPLY: finished
0806 15:55:16.778837 (+ 53us) log.cc:842] Serialized 22 byte log entry
Related trace 'op':
0806 15:55:16.778066 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:16.778263 (+ 197us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:16.778267 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:16.778268 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:16.778379 (+ 111us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:16.778393 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:16.778395 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:16.778441 (+ 46us) tablet.cc:699] Row locks acquired
0806 15:55:16.778442 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:16.778544 (+ 102us) op_driver.cc:444] REPLICATION: finished
0806 15:55:16.778774 (+ 230us) write_op.cc:301] APPLY: starting
0806 15:55:16.778782 (+ 8us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:16.778796 (+ 14us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:16.778798 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:16.778825 (+ 27us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:16.778840 (+ 15us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:16.778852 (+ 12us) write_op.cc:312] APPLY: finished
0806 15:55:16.778883 (+ 31us) log.cc:842] Serialized 22 byte log entry
Metrics: {"thread_start_us":93,"threads_started":1,"wal-append.queue_time_us":197,"child_traces":[["op",{"apply.queue_time_us":143,"num_ops":1,"partition_lock_wait_us":6,"prepare.queue_time_us":213,"prepare.run_cpu_time_us":294,"prepare.run_wall_time_us":295,"replication_time_us":1157257,"thread_start_us":146,"threads_started":2}],["op",{"apply.queue_time_us":201,"num_ops":1,"partition_lock_wait_us":6,"prepare.queue_time_us":74,"prepare.run_cpu_time_us":462,"prepare.run_wall_time_us":462,"replication_time_us":201878,"thread_start_us":67,"threads_started":1}]]}
I20260806 15:55:16.779515 14072 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:16.779940 13614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:16.780092 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:16.780663 13829 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:16.780853 14072 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:17.245823 14076 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:17.296783 14129 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=26, attempt_no=0}) took 1894 ms. Trace:
I20260806 15:55:17.296878 14129 rpcz_store.cc:276] 0806 15:55:15.402678 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:15.402729 (+ 51us) service_pool.cc:227] Handling call
0806 15:55:17.296764 (+1894035us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:15.792591 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:15.792714 (+ 123us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:15.792719 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:55:15.792721 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:15.792798 (+ 77us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:15.792832 (+ 34us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:15.792837 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:15.792890 (+ 53us) tablet.cc:699] Row locks acquired
0806 15:55:15.792892 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:55:15.792931 (+ 39us) write_op.cc:270] Start()
0806 15:55:16.240115 (+447184us) write_op.cc:276] Timestamp: P: 1786031715792892 usec, L: 0
0806 15:55:16.240119 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:16.240359 (+ 240us) log.cc:842] Serialized 354 byte log entry
0806 15:55:17.296095 (+1055736us) op_driver.cc:444] REPLICATION: finished
0806 15:55:17.296392 (+ 297us) write_op.cc:301] APPLY: starting
0806 15:55:17.296411 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:17.296440 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:17.296457 (+ 17us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:17.296522 (+ 65us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:17.296548 (+ 26us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:17.296551 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:17.296621 (+ 70us) log.cc:842] Serialized 22 byte log entry
0806 15:55:17.296675 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:17.296687 (+ 12us) write_op.cc:454] Released schema lock
0806 15:55:17.296691 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":227,"num_ops":1,"prepare.queue_time_us":389473,"prepare.run_cpu_time_us":755,"prepare.run_wall_time_us":447838,"replication_time_us":1055932,"thread_start_us":101,"threads_started":1}]]}
I20260806 15:55:17.454411 14076 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:17.454558 14076 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:17.455097 14076 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:17.455511 13894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 29 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:17.455511 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 29 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:17.455950 13544 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:17.456274 14076 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:17.479434 14129 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=27, attempt_no=0}) took 1124 ms. Trace:
I20260806 15:55:17.479605 14129 rpcz_store.cc:276] 0806 15:55:16.354670 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:16.354730 (+ 60us) service_pool.cc:227] Handling call
0806 15:55:17.479415 (+1124685us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:16.355121 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:16.355237 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:16.355240 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:55:16.355241 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:16.355310 (+ 69us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:16.355317 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:16.355318 (+ 1us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:16.355346 (+ 28us) tablet.cc:699] Row locks acquired
0806 15:55:16.355347 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:16.355379 (+ 32us) write_op.cc:270] Start()
0806 15:55:17.029526 (+674147us) write_op.cc:276] Timestamp: P: 1786031716355346 usec, L: 0
0806 15:55:17.029530 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:17.029953 (+ 423us) log.cc:842] Serialized 354 byte log entry
0806 15:55:17.478703 (+448750us) op_driver.cc:444] REPLICATION: finished
0806 15:55:17.478851 (+ 148us) write_op.cc:301] APPLY: starting
0806 15:55:17.478869 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:17.478896 (+ 27us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:17.478938 (+ 42us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:17.479059 (+ 121us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:17.479103 (+ 44us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:17.479106 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:17.479205 (+ 99us) log.cc:842] Serialized 22 byte log entry
0806 15:55:17.479319 (+ 114us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:17.479333 (+ 14us) write_op.cc:454] Released schema lock
0806 15:55:17.479339 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":70,"num_ops":1,"prepare.queue_time_us":45,"prepare.run_cpu_time_us":827,"prepare.run_wall_time_us":674891,"replication_time_us":449143}]]}
W20260806 15:55:17.480919 13995 scanner-internal.cc:458] Time spent opening tablet: real 0.976s user 0.000s sys 0.000s
W20260806 15:55:17.480938 13994 scanner-internal.cc:458] Time spent opening tablet: real 0.976s user 0.001s sys 0.000s
I20260806 15:55:18.123214 14076 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:18.123376 14076 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:18.123888 14076 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:18.124348 13894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 30 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:18.124579 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 30 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:18.125082 13543 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:18.125267 14076 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260806 15:55:18.165216 13995 scanner-internal.cc:458] Time spent opening tablet: real 0.534s user 0.001s sys 0.000s
W20260806 15:55:18.165233 13994 scanner-internal.cc:458] Time spent opening tablet: real 0.534s user 0.001s sys 0.000s
I20260806 15:55:18.196403 14072 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:18.196542 14072 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:18.196704 13896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.189.194:44759 (request call id 2033) took 1416 ms. Trace:
I20260806 15:55:18.197103 14072 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:18.196780 13896 rpcz_store.cc:276] 0806 15:55:16.780640 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:16.780697 (+ 57us) service_pool.cc:227] Handling call
0806 15:55:16.780849 (+ 152us) raft_consensus.cc:1457] Updating replica for 2 ops
0806 15:55:16.781024 (+ 175us) raft_consensus.cc:1520] Early marking committed up to index 0
0806 15:55:16.781027 (+ 3us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0806 15:55:16.781123 (+ 96us) write_op.cc:270] Start()
0806 15:55:17.662255 (+881132us) write_op.cc:276] Timestamp: P: 1786031714953960 usec, L: 0
0806 15:55:17.662564 (+ 309us) write_op.cc:270] Start()
0806 15:55:18.195719 (+533155us) write_op.cc:276] Timestamp: P: 1786031715792892 usec, L: 0
0806 15:55:18.196082 (+ 363us) log.cc:842] Serialized 708 byte log entry
0806 15:55:18.196209 (+ 127us) raft_consensus.cc:1631] Marking committed up to 27
0806 15:55:18.196350 (+ 141us) raft_consensus.cc:1683] Filling consensus response to leader.
0806 15:55:18.196385 (+ 35us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0806 15:55:18.196644 (+ 259us) raft_consensus.cc:1671] finished
0806 15:55:18.196647 (+ 3us) raft_consensus.cc:1677] UpdateReplicas() finished
0806 15:55:18.196689 (+ 42us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:17.662577 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:17.662669 (+ 92us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:17.662673 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:17.662674 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:17.662740 (+ 66us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:17.662749 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:17.662751 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:17.662786 (+ 35us) tablet.cc:699] Row locks acquired
0806 15:55:17.662787 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:18.196237 (+533450us) op_driver.cc:444] REPLICATION: finished
0806 15:55:18.196431 (+ 194us) write_op.cc:301] APPLY: starting
0806 15:55:18.196446 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:18.196485 (+ 39us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:18.196487 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:18.196542 (+ 55us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:18.196574 (+ 32us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:18.196592 (+ 18us) write_op.cc:312] APPLY: finished
0806 15:55:18.196649 (+ 57us) log.cc:842] Serialized 22 byte log entry
0806 15:55:18.196698 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:18.196707 (+ 9us) write_op.cc:454] Released schema lock
0806 15:55:18.196712 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0806 15:55:18.196782 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:18.196785 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0806 15:55:18.196040 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:18.196133 (+ 93us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:18.196137 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:18.196138 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:18.196204 (+ 66us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:18.196213 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:18.196215 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:18.196251 (+ 36us) tablet.cc:699] Row locks acquired
0806 15:55:18.196252 (+ 1us) write_op.cc:260] PREPARE: finished
Metrics: {"spinlock_wait_cycles":220032,"thread_start_us":78,"threads_started":1,"wal-append.queue_time_us":137,"child_traces":[["op",{"apply.queue_time_us":147,"apply.run_cpu_time_us":395,"apply.run_wall_time_us":395,"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":207,"prepare.run_cpu_time_us":274,"prepare.run_wall_time_us":273,"replication_time_us":1415102,"thread_start_us":154,"threads_started":2}],["op",{"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":211,"prepare.run_cpu_time_us":277,"prepare.run_wall_time_us":276,"thread_start_us":75,"threads_started":1}]]}
I20260806 15:55:18.197431 13614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:18.197584 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:18.198225 13831 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:18.490644 14076 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:18.490803 14076 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:18.491345 14076 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:18.491745 13894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 31 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:18.491921 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 31 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:18.492295 13543 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:18.492515 14076 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:18.518417 14134 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=29, attempt_no=0}) took 1037 ms. Trace:
I20260806 15:55:18.518536 14134 rpcz_store.cc:276] 0806 15:55:17.481340 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:17.481410 (+ 70us) service_pool.cc:227] Handling call
0806 15:55:18.518397 (+1036987us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:17.673772 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:17.673877 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:17.673882 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:55:17.673884 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:17.673968 (+ 84us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:17.673975 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:17.673977 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:17.674029 (+ 52us) tablet.cc:699] Row locks acquired
0806 15:55:17.674031 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:55:17.674070 (+ 39us) write_op.cc:270] Start()
0806 15:55:18.282200 (+608130us) write_op.cc:276] Timestamp: P: 1786031717674015 usec, L: 0
0806 15:55:18.282206 (+ 6us) op_driver.cc:331] REPLICATION: starting
0806 15:55:18.282386 (+ 180us) log.cc:842] Serialized 354 byte log entry
0806 15:55:18.517756 (+235370us) op_driver.cc:444] REPLICATION: finished
0806 15:55:18.517900 (+ 144us) write_op.cc:301] APPLY: starting
0806 15:55:18.517938 (+ 38us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:18.517969 (+ 31us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:18.517988 (+ 19us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:18.518097 (+ 109us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:18.518136 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:18.518140 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:55:18.518221 (+ 81us) log.cc:842] Serialized 22 byte log entry
0806 15:55:18.518293 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:18.518309 (+ 16us) write_op.cc:454] Released schema lock
0806 15:55:18.518315 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":53,"num_ops":1,"prepare.queue_time_us":192053,"prepare.run_cpu_time_us":657,"prepare.run_wall_time_us":608689,"replication_time_us":235520}]]}
I20260806 15:55:18.969815 14072 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:19.010807 14072 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:19.010953 14072 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:19.011478 14072 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:19.011826 13614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 31 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:19.011869 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 31 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:19.012387 13829 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:19.012563 14072 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:19.971146 14072 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:19.971318 14072 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:19.971879 14072 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:19.972289 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 32 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:19.972329 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 32 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:19.972896 13831 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:19.973093 14072 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:20.003867 14146 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=30, attempt_no=0}) took 1838 ms. Trace:
I20260806 15:55:20.004031 14146 rpcz_store.cc:276] 0806 15:55:18.165217 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:18.165258 (+ 41us) service_pool.cc:227] Handling call
0806 15:55:20.003844 (+1838586us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:18.282503 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:18.282629 (+ 126us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:18.282633 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:18.282634 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:18.282714 (+ 80us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:18.282725 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:18.282729 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:18.282774 (+ 45us) tablet.cc:699] Row locks acquired
0806 15:55:18.282775 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:18.282814 (+ 39us) write_op.cc:270] Start()
0806 15:55:19.146980 (+864166us) write_op.cc:276] Timestamp: P: 1786031718282779 usec, L: 0
0806 15:55:19.146984 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:19.147267 (+ 283us) log.cc:842] Serialized 354 byte log entry
0806 15:55:20.003103 (+855836us) op_driver.cc:444] REPLICATION: finished
0806 15:55:20.003401 (+ 298us) write_op.cc:301] APPLY: starting
0806 15:55:20.003423 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:20.003449 (+ 26us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:20.003467 (+ 18us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:20.003532 (+ 65us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:20.003557 (+ 25us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:20.003560 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:20.003630 (+ 70us) log.cc:842] Serialized 22 byte log entry
0806 15:55:20.003738 (+ 108us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:20.003753 (+ 15us) write_op.cc:454] Released schema lock
0806 15:55:20.003758 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":229,"num_ops":1,"prepare.queue_time_us":116897,"prepare.run_cpu_time_us":844,"prepare.run_wall_time_us":864917,"raft.queue_time_us":149,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":190,"replication_time_us":856074,"spinlock_wait_cycles":134528,"thread_start_us":104,"threads_started":1}]]}
I20260806 15:55:20.004768 13714 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:36064 (request call id 70) took 1688 ms. Trace:
I20260806 15:55:20.004856 13714 rpcz_store.cc:276] 0806 15:55:18.316667 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:18.316751 (+ 84us) service_pool.cc:227] Handling call
0806 15:55:18.316946 (+ 195us) tablet_service.cc:2780] Created scanner 284af973ea22486ebe5a5d4244d24bf0 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 2073b0b49d164479b56209aa2add8405
0806 15:55:18.317089 (+ 143us) tablet_service.cc:2920] Creating iterator
0806 15:55:18.317113 (+ 24us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:55:19.147156 (+830043us) tablet_service.cc:3304] Waiting for operations to commit
0806 15:55:20.003789 (+856633us) tablet_service.cc:3320] All operations in snapshot committed. Waited for 1686662 microseconds
0806 15:55:20.003871 (+ 82us) tablet_service.cc:2945] Iterator created
0806 15:55:20.004273 (+ 402us) tablet_service.cc:2967] Iterator init: OK
0806 15:55:20.004293 (+ 20us) tablet_service.cc:3010] has_more: true
0806 15:55:20.004342 (+ 49us) tablet_service.cc:3027] Continuing scan request
0806 15:55:20.004400 (+ 58us) tablet_service.cc:3091] Found scanner 284af973ea22486ebe5a5d4244d24bf0 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 2073b0b49d164479b56209aa2add8405
0806 15:55:20.004758 (+ 358us) inbound_call.cc:173] Queueing success response
Metrics: {"rowset_iterators":1,"scanner_bytes_read":0}
I20260806 15:55:20.004773 13715 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:36064 (request call id 69) took 1688 ms. Trace:
I20260806 15:55:20.005019 13715 rpcz_store.cc:276] 0806 15:55:18.316513 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:18.316592 (+ 79us) service_pool.cc:227] Handling call
0806 15:55:18.316820 (+ 228us) tablet_service.cc:2780] Created scanner 96e7a64d077c47dfade52ebc37bcecf2 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 6af0b1a87f584694aa215322b958f56c
0806 15:55:18.317065 (+ 245us) tablet_service.cc:2920] Creating iterator
0806 15:55:18.317091 (+ 26us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:55:19.147114 (+830023us) tablet_service.cc:3304] Waiting for operations to commit
0806 15:55:20.003766 (+856652us) tablet_service.cc:3320] All operations in snapshot committed. Waited for 1686662 microseconds
0806 15:55:20.003860 (+ 94us) tablet_service.cc:2945] Iterator created
0806 15:55:20.004232 (+ 372us) tablet_service.cc:2967] Iterator init: OK
0806 15:55:20.004256 (+ 24us) tablet_service.cc:3010] has_more: true
0806 15:55:20.004290 (+ 34us) tablet_service.cc:3027] Continuing scan request
0806 15:55:20.004350 (+ 60us) tablet_service.cc:3091] Found scanner 96e7a64d077c47dfade52ebc37bcecf2 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 6af0b1a87f584694aa215322b958f56c
0806 15:55:20.004765 (+ 415us) inbound_call.cc:173] Queueing success response
Metrics: {"rowset_iterators":1,"scanner_bytes_read":0,"spinlock_wait_cycles":768}
W20260806 15:55:20.005493 13995 scanner-internal.cc:458] Time spent opening tablet: real 1.690s user 0.001s sys 0.000s
W20260806 15:55:20.005493 13994 scanner-internal.cc:458] Time spent opening tablet: real 1.690s user 0.001s sys 0.000s
I20260806 15:55:20.067166 14141 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:20.067369 14141 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:20.067965 14141 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:20.068372 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 32 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:20.068400 13894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 32 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:20.068905 13544 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:20.385797 14141 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:20.392396 14146 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=31, attempt_no=0}) took 1872 ms. Trace:
I20260806 15:55:20.392529 14146 rpcz_store.cc:276] 0806 15:55:18.519806 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:18.519879 (+ 73us) service_pool.cc:227] Handling call
0806 15:55:20.392382 (+1872503us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:19.147465 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:19.147601 (+ 136us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:19.147606 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:55:19.147607 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:19.147694 (+ 87us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:19.147703 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:19.147706 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:19.147749 (+ 43us) tablet.cc:699] Row locks acquired
0806 15:55:19.147750 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:19.147785 (+ 35us) write_op.cc:270] Start()
0806 15:55:19.648949 (+501164us) write_op.cc:276] Timestamp: P: 1786031719147766 usec, L: 0
0806 15:55:19.648952 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:55:19.649148 (+ 196us) log.cc:842] Serialized 354 byte log entry
0806 15:55:20.391939 (+742791us) op_driver.cc:444] REPLICATION: finished
0806 15:55:20.392069 (+ 130us) write_op.cc:301] APPLY: starting
0806 15:55:20.392086 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:20.392112 (+ 26us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:20.392129 (+ 17us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:20.392187 (+ 58us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:20.392213 (+ 26us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:20.392216 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:20.392270 (+ 54us) log.cc:842] Serialized 22 byte log entry
0806 15:55:20.392316 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:20.392325 (+ 9us) write_op.cc:454] Released schema lock
0806 15:55:20.392329 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":76,"num_ops":1,"prepare.queue_time_us":627240,"prepare.run_cpu_time_us":666,"prepare.run_wall_time_us":501742,"replication_time_us":742961}]]}
I20260806 15:55:20.556385 14072 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:20.556588 14072 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:20.557116 14072 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:20.557582 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 33 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:20.557716 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 33 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:20.558454 13831 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:20.629043 14072 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:21.339732 14141 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:21.339900 14141 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:21.340451 14141 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:21.340873 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 34 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:21.340924 13894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 34 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:21.341382 13544 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:21.404052 14072 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:21.404191 14072 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:21.404713 14072 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:21.405150 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:21.405213 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:21.405711 13831 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:21.406044 14072 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:21.406203 14141 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:21.412294 14159 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=33, attempt_no=0}) took 1018 ms. Trace:
I20260806 15:55:21.412406 14159 rpcz_store.cc:276] 0806 15:55:20.393795 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:20.393865 (+ 70us) service_pool.cc:227] Handling call
0806 15:55:21.412277 (+1018412us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:20.402715 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:20.402820 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:20.402824 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:20.402825 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:20.402898 (+ 73us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:20.402908 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:20.402911 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:20.402959 (+ 48us) tablet.cc:699] Row locks acquired
0806 15:55:20.402960 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:20.402985 (+ 25us) write_op.cc:270] Start()
0806 15:55:20.734130 (+331145us) write_op.cc:276] Timestamp: P: 1786031720402947 usec, L: 0
0806 15:55:20.734134 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:20.734338 (+ 204us) log.cc:842] Serialized 354 byte log entry
0806 15:55:21.411484 (+677146us) op_driver.cc:444] REPLICATION: finished
0806 15:55:21.411925 (+ 441us) write_op.cc:301] APPLY: starting
0806 15:55:21.411940 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:21.411982 (+ 42us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:21.411999 (+ 17us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:21.412048 (+ 49us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:21.412078 (+ 30us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:21.412084 (+ 6us) write_op.cc:312] APPLY: finished
0806 15:55:21.412142 (+ 58us) log.cc:842] Serialized 22 byte log entry
0806 15:55:21.412198 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:21.412207 (+ 9us) write_op.cc:454] Released schema lock
0806 15:55:21.412212 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":173,"num_ops":1,"prepare.queue_time_us":8460,"prepare.run_cpu_time_us":631,"prepare.run_wall_time_us":331684,"replication_time_us":677324,"thread_start_us":80,"threads_started":1}]]}
I20260806 15:55:21.827579 14141 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:21.827757 14141 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:21.828291 14141 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:21.828698 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 36 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:21.828701 13894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 36 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:21.829229 13543 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:21.874402 14159 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=34, attempt_no=0}) took 1224 ms. Trace:
I20260806 15:55:21.874548 14159 rpcz_store.cc:276] 0806 15:55:20.649895 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:20.649911 (+ 16us) service_pool.cc:227] Handling call
0806 15:55:21.874380 (+1224469us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:20.734446 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:20.734544 (+ 98us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:20.734547 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:55:20.734548 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:20.734610 (+ 62us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:20.734618 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:20.734620 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:20.734653 (+ 33us) tablet.cc:699] Row locks acquired
0806 15:55:20.734654 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:20.734683 (+ 29us) write_op.cc:270] Start()
0806 15:55:21.579821 (+845138us) write_op.cc:276] Timestamp: P: 1786031720734647 usec, L: 0
0806 15:55:21.579824 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:55:21.580061 (+ 237us) log.cc:842] Serialized 354 byte log entry
0806 15:55:21.873690 (+293629us) op_driver.cc:444] REPLICATION: finished
0806 15:55:21.873863 (+ 173us) write_op.cc:301] APPLY: starting
0806 15:55:21.873885 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:21.873915 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:21.873936 (+ 21us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:21.874003 (+ 67us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:21.874033 (+ 30us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:21.874035 (+ 2us) write_op.cc:312] APPLY: finished
0806 15:55:21.874142 (+ 107us) log.cc:842] Serialized 22 byte log entry
0806 15:55:21.874261 (+ 119us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:21.874277 (+ 16us) write_op.cc:454] Released schema lock
0806 15:55:21.874283 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":79,"num_ops":1,"prepare.queue_time_us":84142,"prepare.run_cpu_time_us":660,"prepare.run_wall_time_us":845714,"raft.queue_time_us":117,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":273,"replication_time_us":293825,"spinlock_wait_cycles":9984}]]}
I20260806 15:55:21.875319 13714 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:36064 (request call id 77) took 1074 ms. Trace:
I20260806 15:55:21.875336 13715 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:36064 (request call id 78) took 1073 ms. Trace:
I20260806 15:55:21.875412 13714 rpcz_store.cc:276] 0806 15:55:20.801329 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:20.801400 (+ 71us) service_pool.cc:227] Handling call
0806 15:55:20.801591 (+ 191us) tablet_service.cc:2780] Created scanner 2e6c0c165a084406907cee6b4b35822c for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is e780c8feaff5468e86be63eb36c08c71
0806 15:55:20.801764 (+ 173us) tablet_service.cc:2920] Creating iterator
0806 15:55:20.801788 (+ 24us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:55:21.579940 (+778152us) tablet_service.cc:3304] Waiting for operations to commit
0806 15:55:21.874302 (+294362us) tablet_service.cc:3320] All operations in snapshot committed. Waited for 1072498 microseconds
0806 15:55:21.874406 (+ 104us) tablet_service.cc:2945] Iterator created
0806 15:55:21.874750 (+ 344us) tablet_service.cc:2967] Iterator init: OK
0806 15:55:21.874778 (+ 28us) tablet_service.cc:3010] has_more: true
0806 15:55:21.874810 (+ 32us) tablet_service.cc:3027] Continuing scan request
0806 15:55:21.874864 (+ 54us) tablet_service.cc:3091] Found scanner 2e6c0c165a084406907cee6b4b35822c for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is e780c8feaff5468e86be63eb36c08c71
0806 15:55:21.875307 (+ 443us) inbound_call.cc:173] Queueing success response
Metrics: {"rowset_iterators":1,"scanner_bytes_read":0,"spinlock_wait_cycles":24320}
I20260806 15:55:21.875471 13715 rpcz_store.cc:276] 0806 15:55:20.801470 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:20.801537 (+ 67us) service_pool.cc:227] Handling call
0806 15:55:20.801667 (+ 130us) tablet_service.cc:2780] Created scanner fe8b5288feff433da453a8dfe3a9c5ba for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is d333b569e3094564a0acb1cbc4c4a053
0806 15:55:20.801805 (+ 138us) tablet_service.cc:2920] Creating iterator
0806 15:55:20.801826 (+ 21us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:55:21.579971 (+778145us) tablet_service.cc:3304] Waiting for operations to commit
0806 15:55:21.874308 (+294337us) tablet_service.cc:3320] All operations in snapshot committed. Waited for 1072475 microseconds
0806 15:55:21.874406 (+ 98us) tablet_service.cc:2945] Iterator created
0806 15:55:21.874751 (+ 345us) tablet_service.cc:2967] Iterator init: OK
0806 15:55:21.874775 (+ 24us) tablet_service.cc:3010] has_more: true
0806 15:55:21.874810 (+ 35us) tablet_service.cc:3027] Continuing scan request
0806 15:55:21.874864 (+ 54us) tablet_service.cc:3091] Found scanner fe8b5288feff433da453a8dfe3a9c5ba for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is d333b569e3094564a0acb1cbc4c4a053
0806 15:55:21.875307 (+ 443us) inbound_call.cc:173] Queueing success response
Metrics: {"rowset_iterators":1,"scanner_bytes_read":0,"spinlock_wait_cycles":32384}
W20260806 15:55:21.876206 13995 scanner-internal.cc:458] Time spent opening tablet: real 1.076s user 0.001s sys 0.000s
W20260806 15:55:21.876206 13994 scanner-internal.cc:458] Time spent opening tablet: real 1.076s user 0.001s sys 0.000s
I20260806 15:55:22.137785 14072 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:22.137967 14072 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:22.138481 14072 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:22.138890 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 36 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:22.138973 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 36 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:22.139432 13831 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:22.226380 14072 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:22.671089 14141 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:22.850006 14072 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:22.850222 14072 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:22.850754 14072 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:22.851187 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 38 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:22.851195 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 38 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:22.851677 13831 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:22.851861 14072 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260806 15:55:22.864569 13994 scanner-internal.cc:458] Time spent opening tablet: real 0.838s user 0.001s sys 0.000s
W20260806 15:55:22.864645 13995 scanner-internal.cc:458] Time spent opening tablet: real 0.838s user 0.001s sys 0.000s
I20260806 15:55:23.533805 14141 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:23.533964 14141 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:23.534619 14141 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:23.535034 13894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 38 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:23.535240 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 38 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:23.535616 13543 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:23.902925 14072 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:23.903069 14072 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:23.903654 14072 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:23.904114 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 39 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:23.904302 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 39 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:23.904682 13831 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:23.942643 14173 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=37, attempt_no=0}) took 1694 ms. Trace:
I20260806 15:55:23.942764 14173 rpcz_store.cc:276] 0806 15:55:22.248262 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:22.248320 (+ 58us) service_pool.cc:227] Handling call
0806 15:55:23.942620 (+1694300us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:22.632502 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:22.632610 (+ 108us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:22.632615 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:55:22.632617 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:22.632697 (+ 80us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:22.632707 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:22.632710 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:22.632759 (+ 49us) tablet.cc:699] Row locks acquired
0806 15:55:22.632761 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:55:22.632817 (+ 56us) write_op.cc:270] Start()
0806 15:55:23.299964 (+667147us) write_op.cc:276] Timestamp: P: 1786031722632767 usec, L: 0
0806 15:55:23.299969 (+ 5us) op_driver.cc:331] REPLICATION: starting
0806 15:55:23.300206 (+ 237us) log.cc:842] Serialized 354 byte log entry
0806 15:55:23.941218 (+641012us) op_driver.cc:444] REPLICATION: finished
0806 15:55:23.941542 (+ 324us) write_op.cc:301] APPLY: starting
0806 15:55:23.941560 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:23.941588 (+ 28us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:23.941606 (+ 18us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:23.941671 (+ 65us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:23.941710 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:23.941713 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:23.941784 (+ 71us) log.cc:842] Serialized 22 byte log entry
0806 15:55:23.942504 (+ 720us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:23.942519 (+ 15us) write_op.cc:454] Released schema lock
0806 15:55:23.942525 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":257,"num_ops":1,"prepare.queue_time_us":383870,"prepare.run_cpu_time_us":710,"prepare.run_wall_time_us":667788,"replication_time_us":641208,"thread_start_us":118,"threads_started":1}]]}
W20260806 15:55:23.943377 13994 scanner-internal.cc:458] Time spent opening tablet: real 0.928s user 0.001s sys 0.000s
W20260806 15:55:23.943424 13995 scanner-internal.cc:458] Time spent opening tablet: real 0.928s user 0.000s sys 0.000s
I20260806 15:55:24.637796 14072 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:24.683743 14180 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=38, attempt_no=0}) took 1819 ms. Trace:
I20260806 15:55:24.683833 14180 rpcz_store.cc:276] 0806 15:55:22.864524 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:22.864825 (+ 301us) service_pool.cc:227] Handling call
0806 15:55:24.683724 (+1818899us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:23.300311 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:23.300423 (+ 112us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:23.300429 (+ 6us) write_op.cc:435] Acquired schema lock
0806 15:55:23.300433 (+ 4us) tablet.cc:660] Decoding operations
0806 15:55:23.300531 (+ 98us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:23.300541 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:23.300544 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:23.300613 (+ 69us) tablet.cc:699] Row locks acquired
0806 15:55:23.300614 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:23.300656 (+ 42us) write_op.cc:270] Start()
0806 15:55:23.393807 (+ 93151us) write_op.cc:276] Timestamp: P: 1786031723300628 usec, L: 0
0806 15:55:23.393811 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:23.394014 (+ 203us) log.cc:842] Serialized 354 byte log entry
0806 15:55:24.683055 (+1289041us) op_driver.cc:444] REPLICATION: finished
0806 15:55:24.683362 (+ 307us) write_op.cc:301] APPLY: starting
0806 15:55:24.683381 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:24.683408 (+ 27us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:24.683426 (+ 18us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:24.683488 (+ 62us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:24.683515 (+ 27us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:24.683519 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:55:24.683588 (+ 69us) log.cc:842] Serialized 22 byte log entry
0806 15:55:24.683638 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:24.683650 (+ 12us) write_op.cc:454] Released schema lock
0806 15:55:24.683654 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":243,"num_ops":1,"prepare.queue_time_us":435136,"prepare.run_cpu_time_us":732,"prepare.run_wall_time_us":93797,"replication_time_us":1289200,"thread_start_us":126,"threads_started":1}]]}
I20260806 15:55:24.763294 14072 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:24.763455 14072 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:24.764008 14072 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:24.764415 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:24.764585 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:24.765072 13829 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:24.765271 14072 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260806 15:55:24.807122 13994 scanner-internal.cc:458] Time spent opening tablet: real 0.713s user 0.001s sys 0.000s
W20260806 15:55:24.807122 13995 scanner-internal.cc:458] Time spent opening tablet: real 0.713s user 0.001s sys 0.000s
I20260806 15:55:24.827497 14141 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:24.828069 13614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.189.194:38337 (request call id 3441) took 1293 ms. Trace:
I20260806 15:55:24.828181 13614 rpcz_store.cc:276] 0806 15:55:23.534957 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:23.535366 (+ 409us) service_pool.cc:227] Handling call
0806 15:55:23.535516 (+ 150us) raft_consensus.cc:1457] Updating replica for 2 ops
0806 15:55:23.535616 (+ 100us) raft_consensus.cc:1520] Early marking committed up to index 38
0806 15:55:23.535787 (+ 171us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0806 15:55:23.535873 (+ 86us) write_op.cc:270] Start()
0806 15:55:24.084076 (+548203us) write_op.cc:276] Timestamp: P: 1786031722632767 usec, L: 0
0806 15:55:24.084626 (+ 550us) write_op.cc:270] Start()
0806 15:55:24.826784 (+742158us) write_op.cc:276] Timestamp: P: 1786031723300628 usec, L: 0
0806 15:55:24.827256 (+ 472us) log.cc:842] Serialized 708 byte log entry
0806 15:55:24.827416 (+ 160us) raft_consensus.cc:1631] Marking committed up to 38
0806 15:55:24.827423 (+ 7us) raft_consensus.cc:1683] Filling consensus response to leader.
0806 15:55:24.827451 (+ 28us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0806 15:55:24.828004 (+ 553us) raft_consensus.cc:1671] finished
0806 15:55:24.828008 (+ 4us) raft_consensus.cc:1677] UpdateReplicas() finished
0806 15:55:24.828055 (+ 47us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:24.084512 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:24.084641 (+ 129us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:24.084647 (+ 6us) write_op.cc:435] Acquired schema lock
0806 15:55:24.084651 (+ 4us) tablet.cc:660] Decoding operations
0806 15:55:24.084739 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:24.084752 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:24.084754 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:24.084797 (+ 43us) tablet.cc:699] Row locks acquired
0806 15:55:24.084840 (+ 43us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0806 15:55:24.827199 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:24.827300 (+ 101us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:24.827304 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:24.827306 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:24.827424 (+ 118us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:24.827473 (+ 49us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:24.827479 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:24.827559 (+ 80us) tablet.cc:699] Row locks acquired
0806 15:55:24.827561 (+ 2us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":99,"threads_started":1,"wal-append.queue_time_us":167,"child_traces":[["op",{"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":275,"prepare.run_cpu_time_us":415,"prepare.run_wall_time_us":416,"thread_start_us":126,"threads_started":1}],["op",{"num_ops":1,"partition_lock_wait_us":38,"prepare.queue_time_us":265,"prepare.run_cpu_time_us":453,"prepare.run_wall_time_us":451,"thread_start_us":105,"threads_started":1}]]}
I20260806 15:55:25.156520 14141 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:25.156687 14141 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:25.157212 14141 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:25.157647 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:25.157647 13896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:25.158152 13543 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:25.158330 14141 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:25.939618 14141 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:25.939782 14141 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:25.940451 14141 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:25.940928 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 42 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:25.941038 13896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 42 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:25.941636 13543 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:25.941867 14141 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:25.962568 14191 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=40, attempt_no=0}) took 1277 ms. Trace:
I20260806 15:55:25.962697 14191 rpcz_store.cc:276] 0806 15:55:24.685439 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:24.685528 (+ 89us) service_pool.cc:227] Handling call
0806 15:55:25.962546 (+1277018us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:24.686066 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:24.686241 (+ 175us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:24.686247 (+ 6us) write_op.cc:435] Acquired schema lock
0806 15:55:24.686249 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:24.686335 (+ 86us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:24.686341 (+ 6us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:24.686344 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:24.686394 (+ 50us) tablet.cc:699] Row locks acquired
0806 15:55:24.686395 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:24.686426 (+ 31us) write_op.cc:270] Start()
0806 15:55:25.193570 (+507144us) write_op.cc:276] Timestamp: P: 1786031724686370 usec, L: 0
0806 15:55:25.193574 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:25.193793 (+ 219us) log.cc:842] Serialized 354 byte log entry
0806 15:55:25.961736 (+767943us) op_driver.cc:444] REPLICATION: finished
0806 15:55:25.962069 (+ 333us) write_op.cc:301] APPLY: starting
0806 15:55:25.962116 (+ 47us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:25.962143 (+ 27us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:25.962161 (+ 18us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:25.962221 (+ 60us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:25.962246 (+ 25us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:25.962249 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:25.962318 (+ 69us) log.cc:842] Serialized 22 byte log entry
0806 15:55:25.962427 (+ 109us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:25.962441 (+ 14us) write_op.cc:454] Released schema lock
0806 15:55:25.962447 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":271,"num_ops":1,"prepare.queue_time_us":173,"prepare.run_cpu_time_us":741,"prepare.run_wall_time_us":507813,"raft.queue_time_us":42,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":237,"replication_time_us":768122,"spinlock_wait_cycles":11520,"thread_start_us":235,"threads_started":2}]]}
I20260806 15:55:25.963449 13714 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:36064 (request call id 93) took 1004 ms. Trace:
I20260806 15:55:25.963578 13715 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:36064 (request call id 92) took 1005 ms. Trace:
I20260806 15:55:25.963532 13714 rpcz_store.cc:276] 0806 15:55:24.958512 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:24.958597 (+ 85us) service_pool.cc:227] Handling call
0806 15:55:24.958713 (+ 116us) tablet_service.cc:2780] Created scanner 81322ffee15940c0a5e639c5032301dd for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 13754048e6254d8284bdf50437958c64
0806 15:55:24.958847 (+ 134us) tablet_service.cc:2920] Creating iterator
0806 15:55:24.958866 (+ 19us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:55:25.193716 (+234850us) tablet_service.cc:3304] Waiting for operations to commit
0806 15:55:25.962474 (+768758us) tablet_service.cc:3320] All operations in snapshot committed. Waited for 1003591 microseconds
0806 15:55:25.962574 (+ 100us) tablet_service.cc:2945] Iterator created
0806 15:55:25.962925 (+ 351us) tablet_service.cc:2967] Iterator init: OK
0806 15:55:25.962952 (+ 27us) tablet_service.cc:3010] has_more: true
0806 15:55:25.962982 (+ 30us) tablet_service.cc:3027] Continuing scan request
0806 15:55:25.963044 (+ 62us) tablet_service.cc:3091] Found scanner 81322ffee15940c0a5e639c5032301dd for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 13754048e6254d8284bdf50437958c64
0806 15:55:25.963437 (+ 393us) inbound_call.cc:173] Queueing success response
Metrics: {"rowset_iterators":1,"scanner_bytes_read":0,"spinlock_wait_cycles":12288}
I20260806 15:55:25.963673 13715 rpcz_store.cc:276] 0806 15:55:24.958421 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:24.958482 (+ 61us) service_pool.cc:227] Handling call
0806 15:55:24.958638 (+ 156us) tablet_service.cc:2780] Created scanner 959fa1217a7e4a25a20b9f27876c5259 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 3a8753b6c73649369849cb223fe959ec
0806 15:55:24.958809 (+ 171us) tablet_service.cc:2920] Creating iterator
0806 15:55:24.958831 (+ 22us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:55:25.193671 (+234840us) tablet_service.cc:3304] Waiting for operations to commit
0806 15:55:25.962474 (+768803us) tablet_service.cc:3320] All operations in snapshot committed. Waited for 1003625 microseconds
0806 15:55:25.962574 (+ 100us) tablet_service.cc:2945] Iterator created
0806 15:55:25.962925 (+ 351us) tablet_service.cc:2967] Iterator init: OK
0806 15:55:25.962950 (+ 25us) tablet_service.cc:3010] has_more: true
0806 15:55:25.962982 (+ 32us) tablet_service.cc:3027] Continuing scan request
0806 15:55:25.963044 (+ 62us) tablet_service.cc:3091] Found scanner 959fa1217a7e4a25a20b9f27876c5259 for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 3a8753b6c73649369849cb223fe959ec
0806 15:55:25.963567 (+ 523us) inbound_call.cc:173] Queueing success response
Metrics: {"rowset_iterators":1,"scanner_bytes_read":0,"spinlock_wait_cycles":24448}
W20260806 15:55:25.964094 13995 scanner-internal.cc:458] Time spent opening tablet: real 1.006s user 0.001s sys 0.000s
W20260806 15:55:25.964170 13994 scanner-internal.cc:458] Time spent opening tablet: real 1.006s user 0.001s sys 0.000s
I20260806 15:55:25.974880 14072 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:25.975005 14072 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:25.975589 14072 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:25.975972 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 42 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:25.976089 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 42 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:25.976576 13829 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:26.363963 14141 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:26.364144 14141 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:26.364724 14141 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:26.365123 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:26.365123 13896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:26.365604 13543 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:26.408806 14191 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=41, attempt_no=0}) took 1601 ms. Trace:
I20260806 15:55:26.408907 14191 rpcz_store.cc:276] 0806 15:55:24.807111 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:24.807169 (+ 58us) service_pool.cc:227] Handling call
0806 15:55:26.408786 (+1601617us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:25.193915 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:25.194021 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:25.194025 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:25.194027 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:25.194123 (+ 96us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:25.194135 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:25.194138 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:25.194180 (+ 42us) tablet.cc:699] Row locks acquired
0806 15:55:25.194182 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:55:25.194217 (+ 35us) write_op.cc:270] Start()
0806 15:55:25.282368 (+ 88151us) write_op.cc:276] Timestamp: P: 1786031725194155 usec, L: 0
0806 15:55:25.282372 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:25.282584 (+ 212us) log.cc:842] Serialized 354 byte log entry
0806 15:55:26.408157 (+1125573us) op_driver.cc:444] REPLICATION: finished
0806 15:55:26.408304 (+ 147us) write_op.cc:301] APPLY: starting
0806 15:55:26.408327 (+ 23us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:26.408356 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:26.408375 (+ 19us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:26.408457 (+ 82us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:26.408487 (+ 30us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:26.408490 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:26.408563 (+ 73us) log.cc:842] Serialized 22 byte log entry
0806 15:55:26.408653 (+ 90us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:26.408666 (+ 13us) write_op.cc:454] Released schema lock
0806 15:55:26.408672 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":63,"num_ops":1,"prepare.queue_time_us":386385,"prepare.run_cpu_time_us":662,"prepare.run_wall_time_us":88724,"replication_time_us":1125741}]]}
I20260806 15:55:26.638638 14072 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:26.796535 14141 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260806 15:55:26.816372 13995 scanner-internal.cc:458] Time spent opening tablet: real 0.702s user 0.001s sys 0.000s
W20260806 15:55:26.816525 13994 scanner-internal.cc:458] Time spent opening tablet: real 0.702s user 0.001s sys 0.000s
I20260806 15:55:27.488158 14072 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:27.488816 14072 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:27.489329 14072 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:27.489789 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 44 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:27.490264 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 44 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:27.490742 13829 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:27.887710 14072 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:27.920710 14201 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=43, attempt_no=0}) took 1510 ms. Trace:
I20260806 15:55:27.920886 14201 rpcz_store.cc:276] 0806 15:55:26.410383 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:26.410475 (+ 92us) service_pool.cc:227] Handling call
0806 15:55:27.920688 (+1510213us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:26.410928 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:26.411012 (+ 84us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:26.411015 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:55:26.411016 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:26.411072 (+ 56us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:26.411079 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:26.411081 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:26.411110 (+ 29us) tablet.cc:699] Row locks acquired
0806 15:55:26.411111 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:26.411139 (+ 28us) write_op.cc:270] Start()
0806 15:55:27.172283 (+761144us) write_op.cc:276] Timestamp: P: 1786031726411113 usec, L: 0
0806 15:55:27.172287 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:27.172533 (+ 246us) log.cc:842] Serialized 354 byte log entry
0806 15:55:27.919861 (+747328us) op_driver.cc:444] REPLICATION: finished
0806 15:55:27.920152 (+ 291us) write_op.cc:301] APPLY: starting
0806 15:55:27.920171 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:27.920236 (+ 65us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:27.920259 (+ 23us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:27.920351 (+ 92us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:27.920383 (+ 32us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:27.920387 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:55:27.920468 (+ 81us) log.cc:842] Serialized 22 byte log entry
0806 15:55:27.920577 (+ 109us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:27.920591 (+ 14us) write_op.cc:454] Released schema lock
0806 15:55:27.920597 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":219,"num_ops":1,"prepare.queue_time_us":71,"prepare.run_cpu_time_us":630,"prepare.run_wall_time_us":761704,"raft.queue_time_us":29,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":145,"replication_time_us":747534,"thread_start_us":95,"threads_started":1}]]}
W20260806 15:55:27.922175 13994 scanner-internal.cc:458] Time spent opening tablet: real 0.955s user 0.001s sys 0.000s
W20260806 15:55:27.922209 13995 scanner-internal.cc:458] Time spent opening tablet: real 0.955s user 0.001s sys 0.000s
I20260806 15:55:28.044163 14141 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:28.044359 14141 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:28.044898 14141 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:28.045331 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:28.045367 13896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:28.045816 13544 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:28.250989 14072 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:28.251150 14072 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:28.251722 14072 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:28.252156 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 46 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:28.252156 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 46 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:28.252641 13829 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:28.252811 14072 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:28.280699 14201 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=44, attempt_no=0}) took 1464 ms. Trace:
I20260806 15:55:28.280794 14201 rpcz_store.cc:276] 0806 15:55:26.816258 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:26.816348 (+ 90us) service_pool.cc:227] Handling call
0806 15:55:28.280663 (+1464315us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:27.172670 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:27.172774 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:27.172777 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:55:27.172778 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:27.172889 (+ 111us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:27.172901 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:27.172904 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:27.172947 (+ 43us) tablet.cc:699] Row locks acquired
0806 15:55:27.172949 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:55:27.172987 (+ 38us) write_op.cc:270] Start()
0806 15:55:27.604182 (+431195us) write_op.cc:276] Timestamp: P: 1786031727172938 usec, L: 0
0806 15:55:27.604186 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:27.604389 (+ 203us) log.cc:842] Serialized 354 byte log entry
0806 15:55:28.280143 (+675754us) op_driver.cc:444] REPLICATION: finished
0806 15:55:28.280257 (+ 114us) write_op.cc:301] APPLY: starting
0806 15:55:28.280283 (+ 26us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:28.280310 (+ 27us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:28.280325 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:28.280385 (+ 60us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:28.280413 (+ 28us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:28.280416 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:28.280481 (+ 65us) log.cc:842] Serialized 22 byte log entry
0806 15:55:28.280558 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:28.280574 (+ 16us) write_op.cc:454] Released schema lock
0806 15:55:28.280579 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":49,"num_ops":1,"prepare.queue_time_us":355929,"prepare.run_cpu_time_us":718,"prepare.run_wall_time_us":431806,"replication_time_us":675926}]]}
I20260806 15:55:28.901793 14141 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:29.080353 14072 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:29.080524 14072 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:29.081080 14072 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:29.081503 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:29.081960 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:29.082412 13829 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:29.104527 14212 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=45, attempt_no=0}) took 1181 ms. Trace:
I20260806 15:55:29.104629 14212 rpcz_store.cc:276] 0806 15:55:27.922692 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:27.922757 (+ 65us) service_pool.cc:227] Handling call
0806 15:55:29.104500 (+1181743us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:27.923190 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:27.923260 (+ 70us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:27.923263 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:55:27.923265 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:27.923322 (+ 57us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:27.923329 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:27.923345 (+ 16us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:27.923376 (+ 31us) tablet.cc:699] Row locks acquired
0806 15:55:27.923377 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:27.923405 (+ 28us) write_op.cc:270] Start()
0806 15:55:28.267544 (+344139us) write_op.cc:276] Timestamp: P: 1786031727923368 usec, L: 0
0806 15:55:28.267548 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:28.267804 (+ 256us) log.cc:842] Serialized 354 byte log entry
0806 15:55:29.103707 (+835903us) op_driver.cc:444] REPLICATION: finished
0806 15:55:29.104035 (+ 328us) write_op.cc:301] APPLY: starting
0806 15:55:29.104053 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:29.104080 (+ 27us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:29.104098 (+ 18us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:29.104175 (+ 77us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:29.104202 (+ 27us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:29.104204 (+ 2us) write_op.cc:312] APPLY: finished
0806 15:55:29.104271 (+ 67us) log.cc:842] Serialized 22 byte log entry
0806 15:55:29.104383 (+ 112us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:29.104397 (+ 14us) write_op.cc:454] Released schema lock
0806 15:55:29.104403 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":254,"num_ops":1,"prepare.queue_time_us":54,"prepare.run_cpu_time_us":908,"prepare.run_wall_time_us":344982,"raft.queue_time_us":129,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":836119,"spinlock_wait_cycles":76160,"thread_start_us":319,"threads_started":2}]]}
I20260806 15:55:29.105502 13714 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:36064 (request call id 103) took 1031 ms. Trace:
I20260806 15:55:29.105502 13715 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:36064 (request call id 102) took 1032 ms. Trace:
I20260806 15:55:29.105619 13715 rpcz_store.cc:276] 0806 15:55:28.073512 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:28.073582 (+ 70us) service_pool.cc:227] Handling call
0806 15:55:28.073795 (+ 213us) tablet_service.cc:2780] Created scanner 06fd1a2eba024e018342f21d835c0e4f for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is dc2522dfb05840ca86f806a07b1571a4
0806 15:55:28.074006 (+ 211us) tablet_service.cc:2920] Creating iterator
0806 15:55:28.074044 (+ 38us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:55:28.267721 (+193677us) tablet_service.cc:3304] Waiting for operations to commit
0806 15:55:29.104455 (+836734us) tablet_service.cc:3320] All operations in snapshot committed. Waited for 1030390 microseconds
0806 15:55:29.104557 (+ 102us) tablet_service.cc:2945] Iterator created
0806 15:55:29.104934 (+ 377us) tablet_service.cc:2967] Iterator init: OK
0806 15:55:29.104966 (+ 32us) tablet_service.cc:3010] has_more: true
0806 15:55:29.104999 (+ 33us) tablet_service.cc:3027] Continuing scan request
0806 15:55:29.105054 (+ 55us) tablet_service.cc:3091] Found scanner 06fd1a2eba024e018342f21d835c0e4f for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is dc2522dfb05840ca86f806a07b1571a4
0806 15:55:29.105491 (+ 437us) inbound_call.cc:173] Queueing success response
Metrics: {"rowset_iterators":1,"scanner_bytes_read":0,"spinlock_wait_cycles":60160}
I20260806 15:55:29.105613 13714 rpcz_store.cc:276] 0806 15:55:28.073584 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:28.073644 (+ 60us) service_pool.cc:227] Handling call
0806 15:55:28.073795 (+ 151us) tablet_service.cc:2780] Created scanner e2d77b83c19f4d41aa67a4d9791d529f for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 6c99520a272f403bbf8813f3eca6f4be
0806 15:55:28.074006 (+ 211us) tablet_service.cc:2920] Creating iterator
0806 15:55:28.074045 (+ 39us) tablet_service.cc:3297] Waiting safe time to advance
0806 15:55:28.267668 (+193623us) tablet_service.cc:3304] Waiting for operations to commit
0806 15:55:29.104455 (+836787us) tablet_service.cc:3320] All operations in snapshot committed. Waited for 1030390 microseconds
0806 15:55:29.104557 (+ 102us) tablet_service.cc:2945] Iterator created
0806 15:55:29.104934 (+ 377us) tablet_service.cc:2967] Iterator init: OK
0806 15:55:29.104963 (+ 29us) tablet_service.cc:3010] has_more: true
0806 15:55:29.104999 (+ 36us) tablet_service.cc:3027] Continuing scan request
0806 15:55:29.105054 (+ 55us) tablet_service.cc:3091] Found scanner e2d77b83c19f4d41aa67a4d9791d529f for tablet c4200ab19d2947ec8e84e935ab5c6fc4, query id is 6c99520a272f403bbf8813f3eca6f4be
0806 15:55:29.105491 (+ 437us) inbound_call.cc:173] Queueing success response
Metrics: {"rowset_iterators":1,"scanner_bytes_read":0,"spinlock_wait_cycles":126080}
W20260806 15:55:29.106338 13994 scanner-internal.cc:458] Time spent opening tablet: real 1.034s user 0.001s sys 0.000s
W20260806 15:55:29.106374 13995 scanner-internal.cc:458] Time spent opening tablet: real 1.034s user 0.001s sys 0.000s
I20260806 15:55:29.152205 14072 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:29.243301 14141 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:29.243451 14141 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:29.244020 14141 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:29.244318 13894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:29.244517 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:29.245425 13544 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:29.465564 14141 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:29.930950 14072 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:29.931118 14072 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:29.931705 14072 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:29.932119 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 49 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:29.932126 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 49 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:29.932605 13831 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:29.932849 14072 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260806 15:55:29.975112 13994 scanner-internal.cc:458] Time spent opening tablet: real 0.718s user 0.001s sys 0.000s
W20260806 15:55:29.975337 13995 scanner-internal.cc:458] Time spent opening tablet: real 0.718s user 0.001s sys 0.000s
I20260806 15:55:30.536934 14141 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:30.537086 14141 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:30.537775 14141 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:30.538115 13896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 49 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:30.538491 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 49 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:30.538883 13543 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:30.749691 14217 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:30.749847 14217 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:30.750828 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 50 } } ignore_live_leader: false dest_uuid: "31b5f45092c144fe97d06a04bed2a7ae" is_pre_election: true
I20260806 15:55:30.750828 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "244ee99675694dc096cd316813818bd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 50 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:30.750440 14217 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:30.751376 13831 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244ee99675694dc096cd316813818bd9; no voters: 31b5f45092c144fe97d06a04bed2a7ae, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:30.794751 14224 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=48, attempt_no=0}) took 1623 ms. Trace:
I20260806 15:55:30.794869 14224 rpcz_store.cc:276] 0806 15:55:29.171012 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:29.171055 (+ 43us) service_pool.cc:227] Handling call
0806 15:55:30.794729 (+1623674us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:29.557487 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:29.557590 (+ 103us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:29.557594 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:29.557596 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:29.557679 (+ 83us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:29.557688 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:29.557691 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:29.557731 (+ 40us) tablet.cc:699] Row locks acquired
0806 15:55:29.557733 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:55:29.557770 (+ 37us) write_op.cc:270] Start()
0806 15:55:30.527932 (+970162us) write_op.cc:276] Timestamp: P: 1786031729557724 usec, L: 0
0806 15:55:30.527935 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:55:30.528135 (+ 200us) log.cc:842] Serialized 354 byte log entry
0806 15:55:30.793859 (+265724us) op_driver.cc:444] REPLICATION: finished
0806 15:55:30.794247 (+ 388us) write_op.cc:301] APPLY: starting
0806 15:55:30.794267 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:30.794294 (+ 27us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:30.794311 (+ 17us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:30.794372 (+ 61us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:30.794397 (+ 25us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:30.794401 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:55:30.794470 (+ 69us) log.cc:842] Serialized 22 byte log entry
0806 15:55:30.794619 (+ 149us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:30.794633 (+ 14us) write_op.cc:454] Released schema lock
0806 15:55:30.794639 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":320,"num_ops":1,"prepare.queue_time_us":386124,"prepare.run_cpu_time_us":680,"prepare.run_wall_time_us":970749,"raft.queue_time_us":41,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":145,"replication_time_us":265882,"thread_start_us":135,"threads_started":1}]]}
W20260806 15:55:30.796061 13994 scanner-internal.cc:458] Time spent opening tablet: real 0.670s user 0.001s sys 0.000s
W20260806 15:55:30.796036 13995 scanner-internal.cc:458] Time spent opening tablet: real 0.670s user 0.001s sys 0.000s
I20260806 15:55:30.960318 14141 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:31.473685 14217 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:31.521708 14229 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36064 (ReqId={client: 65c03450b44b4a8584b942ce1ebf400d, seq_no=49, attempt_no=0}) took 1546 ms. Trace:
I20260806 15:55:31.521812 14229 rpcz_store.cc:276] 0806 15:55:29.975027 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:29.975200 (+ 173us) service_pool.cc:227] Handling call
0806 15:55:31.521690 (+1546490us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:30.528262 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c4200ab19d2947ec8e84e935ab5c6fc4
0806 15:55:30.528371 (+ 109us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:30.528375 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:30.528376 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:30.528455 (+ 79us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:30.528464 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:30.528467 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:30.528515 (+ 48us) tablet.cc:699] Row locks acquired
0806 15:55:30.528518 (+ 3us) write_op.cc:260] PREPARE: finished
0806 15:55:30.528562 (+ 44us) write_op.cc:270] Start()
0806 15:55:30.704732 (+176170us) write_op.cc:276] Timestamp: P: 1786031730528527 usec, L: 0
0806 15:55:30.704737 (+ 5us) op_driver.cc:331] REPLICATION: starting
0806 15:55:30.704967 (+ 230us) log.cc:842] Serialized 354 byte log entry
0806 15:55:31.521061 (+816094us) op_driver.cc:444] REPLICATION: finished
0806 15:55:31.521345 (+ 284us) write_op.cc:301] APPLY: starting
0806 15:55:31.521360 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:31.521386 (+ 26us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:31.521400 (+ 14us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:31.521455 (+ 55us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:31.521481 (+ 26us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:31.521484 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:31.521546 (+ 62us) log.cc:842] Serialized 22 byte log entry
0806 15:55:31.521595 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:31.521627 (+ 32us) write_op.cc:454] Released schema lock
0806 15:55:31.521632 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":223,"num_ops":1,"prepare.queue_time_us":552689,"prepare.run_cpu_time_us":723,"prepare.run_wall_time_us":176801,"replication_time_us":816295,"thread_start_us":108,"threads_started":1}]]}
I20260806 15:55:31.565389 14141 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:31.565512 14141 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:31.566032 14141 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 244ee99675694dc096cd316813818bd9 (127.10.189.195:35263), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
I20260806 15:55:31.566421 13894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 51 } } ignore_live_leader: false dest_uuid: "244ee99675694dc096cd316813818bd9" is_pre_election: true
I20260806 15:55:31.566584 13757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4200ab19d2947ec8e84e935ab5c6fc4" candidate_uuid: "31b5f45092c144fe97d06a04bed2a7ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 51 } } ignore_live_leader: false dest_uuid: "bb3aba5c6068409ea525fe08b90c871f" is_pre_election: true
I20260806 15:55:31.567222 13543 leader_election.cc:302] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31b5f45092c144fe97d06a04bed2a7ae; no voters: 244ee99675694dc096cd316813818bd9, bb3aba5c6068409ea525fe08b90c871f
I20260806 15:55:31.567428 14141 raft_consensus.cc:2726] T c4200ab19d2947ec8e84e935ab5c6fc4 P 31b5f45092c144fe97d06a04bed2a7ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:31.584934 13875 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260806 15:55:31.585981 13592 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260806 15:55:31.587805 13736 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
c729207e25fa4350a5820a4cd9ea3866 | 127.10.189.254:42375 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.189.212:33423 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
244ee99675694dc096cd316813818bd9 | 127.10.189.195:35263 | HEALTHY | <none> | 0 | 0
31b5f45092c144fe97d06a04bed2a7ae | 127.10.189.193:38717 | HEALTHY | <none> | 0 | 0
bb3aba5c6068409ea525fe08b90c871f | 127.10.189.194:42231 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
consensus_inject_latency_ms_in_notifications | 50 | unsafe,hidden | all 3 server(s) checked
inject_latency_ms_before_starting_op | 1000 | hidden,advanced | all 3 server(s) checked
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.10.189.193 | experimental | 127.10.189.193:38717
local_ip_for_outbound_sockets | 127.10.189.194 | experimental | 127.10.189.194:42231
local_ip_for_outbound_sockets | 127.10.189.195 | experimental | 127.10.189.195:35263
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.10.189.193:38717
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.10.189.194:42231
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.10.189.195:35263
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.189.212:33423 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260806 15:55:31.621357 10999 log_verifier.cc:126] Checking tablet c4200ab19d2947ec8e84e935ab5c6fc4
I20260806 15:55:31.666200 10999 log_verifier.cc:177] Verified matching terms for 51 ops in tablet c4200ab19d2947ec8e84e935ab5c6fc4
I20260806 15:55:31.685628 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 13527
W20260806 15:55:31.694773 13690 connection.cc:535] client connection to 127.10.189.193:38717 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 15:55:31.694914 13690 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 1 similar messages]
I20260806 15:55:31.695153 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 13669
I20260806 15:55:31.701306 14217 raft_consensus.cc:482] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb3aba5c6068409ea525fe08b90c871f)
I20260806 15:55:31.701436 14217 raft_consensus.cc:504] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b5f45092c144fe97d06a04bed2a7ae" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38717 } } peers { permanent_uuid: "244ee99675694dc096cd316813818bd9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 35263 } } peers { permanent_uuid: "bb3aba5c6068409ea525fe08b90c871f" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 42231 } }
I20260806 15:55:31.701941 14217 leader_election.cc:288] T c4200ab19d2947ec8e84e935ab5c6fc4 P 244ee99675694dc096cd316813818bd9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b5f45092c144fe97d06a04bed2a7ae (127.10.189.193:38717), bb3aba5c6068409ea525fe08b90c871f (127.10.189.194:42231)
W20260806 15:55:31.702698 13831 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.189.193:38717: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260806 15:55:31.703205 13829 connection.cc:535] client connection to 127.10.189.194:42231 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 15:55:31.703336 13831 connection.cc:535] server connection from 127.10.189.194:44759 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 15:55:31.703603 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 13812
I20260806 15:55:31.710253 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 13432
2026-08-06T15:55:31Z chronyd exiting
[ OK ] RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency (32726 ms)
[ RUN ] RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys
I20260806 15:55:31.736204 10999 test_util.cc:268] Using random seed: -353534328
I20260806 15:55:31.736984 10999 ts_itest-base.cc:112] Starting cluster with:
I20260806 15:55:31.737046 10999 ts_itest-base.cc:113] --------------
I20260806 15:55:31.737066 10999 ts_itest-base.cc:114] 3 tablet servers
I20260806 15:55:31.737093 10999 ts_itest-base.cc:115] 3 replicas per TS
I20260806 15:55:31.737118 10999 ts_itest-base.cc:116] --------------
2026-08-06T15:55:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:55:31Z Disabled control of system clock
I20260806 15:55:31.746363 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:39723
--webserver_interface=127.10.189.254
--webserver_port=0
--builtin_ntp_servers=127.10.189.212:39793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.189.254:39723 with env {}
W20260806 15:55:31.858436 14280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:55:31.858705 14280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:55:31.858777 14280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:55:31.862869 14280 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:55:31.862950 14280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:55:31.862982 14280 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:55:31.863021 14280 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:55:31.867653 14280 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:39793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.189.254:39723
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:39723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.10.189.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.14280
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:55:31.868750 14280 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:55:31.870249 14280 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:55:31.879271 14288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:55:31.879271 14285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:55:31.879315 14286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:55:31.879388 14280 server_base.cc:1034] running on GCE node
I20260806 15:55:31.880182 14280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:55:31.881316 14280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:55:31.882522 14280 hybrid_clock.cc:648] HybridClock initialized: now 1786031731882503 us; error 31 us; skew 500 ppm
I20260806 15:55:31.884521 14280 webserver.cc:460] Webserver started at http://127.10.189.254:37851/ using document root <none> and password file <none>
I20260806 15:55:31.885116 14280 fs_manager.cc:359] Metadata directory not provided
I20260806 15:55:31.885214 14280 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:55:31.885462 14280 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:55:31.887490 14280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "460782632f6c41588199be78d5d78564"
format_stamp: "Formatted at 2026-08-06 15:55:31 on dist-test-slave-mn4r"
I20260806 15:55:31.888079 14280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "460782632f6c41588199be78d5d78564"
format_stamp: "Formatted at 2026-08-06 15:55:31 on dist-test-slave-mn4r"
I20260806 15:55:31.892097 14280 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260806 15:55:31.894773 14294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:55:31.896088 14280 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260806 15:55:31.896242 14280 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
uuid: "460782632f6c41588199be78d5d78564"
format_stamp: "Formatted at 2026-08-06 15:55:31 on dist-test-slave-mn4r"
I20260806 15:55:31.896366 14280 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:55:31.909231 14280 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:55:31.909919 14280 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:55:31.910202 14280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:55:31.917568 14280 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.254:39723
I20260806 15:55:31.917583 14346 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.254:39723 every 8 connection(s)
I20260806 15:55:31.918684 14280 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260806 15:55:31.921995 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 14280
I20260806 15:55:31.922019 14347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:55:31.922187 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260806 15:55:31.929003 14347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564: Bootstrap starting.
I20260806 15:55:31.931696 14347 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564: Neither blocks nor log segments found. Creating new log.
I20260806 15:55:31.932739 14347 log.cc:824] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564: Log is configured to *not* fsync() on all Append() calls
I20260806 15:55:31.934717 14347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564: No bootstrap required, opened a new log
I20260806 15:55:31.938432 14347 raft_consensus.cc:348] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "460782632f6c41588199be78d5d78564" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 39723 } }
I20260806 15:55:31.938656 14347 raft_consensus.cc:374] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:55:31.938712 14347 raft_consensus.cc:729] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 460782632f6c41588199be78d5d78564, State: Initialized, Role: FOLLOWER
I20260806 15:55:31.939117 14347 consensus_queue.cc:260] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "460782632f6c41588199be78d5d78564" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 39723 } }
I20260806 15:55:31.939280 14347 raft_consensus.cc:388] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:55:31.939338 14347 raft_consensus.cc:482] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:55:31.939427 14347 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:55:31.940526 14347 raft_consensus.cc:504] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "460782632f6c41588199be78d5d78564" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 39723 } }
I20260806 15:55:31.940869 14347 leader_election.cc:302] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 460782632f6c41588199be78d5d78564; no voters:
I20260806 15:55:31.941185 14347 leader_election.cc:288] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:55:31.941362 14352 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:55:31.941646 14352 raft_consensus.cc:686] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564 [term 1 LEADER]: Becoming Leader. State: Replica: 460782632f6c41588199be78d5d78564, State: Running, Role: LEADER
I20260806 15:55:31.942065 14352 consensus_queue.cc:237] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "460782632f6c41588199be78d5d78564" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 39723 } }
I20260806 15:55:31.942577 14347 sys_catalog.cc:564] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:55:31.943850 14353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "460782632f6c41588199be78d5d78564" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "460782632f6c41588199be78d5d78564" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 39723 } } }
I20260806 15:55:31.944000 14353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564 [sys.catalog]: This master's current role is: LEADER
I20260806 15:55:31.944408 14362 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:55:31.944352 14355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 460782632f6c41588199be78d5d78564. Latest consensus state: current_term: 1 leader_uuid: "460782632f6c41588199be78d5d78564" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "460782632f6c41588199be78d5d78564" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 39723 } } }
I20260806 15:55:31.945060 14355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564 [sys.catalog]: This master's current role is: LEADER
I20260806 15:55:31.947774 14362 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:55:31.953192 14362 catalog_manager.cc:1347] Generated new cluster ID: d36d1f8715304253a888f8fe746a3ed8
I20260806 15:55:31.953260 14362 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:55:31.981365 14362 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:55:31.982725 14362 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:55:31.990141 14362 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 460782632f6c41588199be78d5d78564: Generated new TSK 0
I20260806 15:55:31.990952 14362 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:55:31.998314 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.193:0
--local_ip_for_outbound_sockets=127.10.189.193
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:39723
--builtin_ntp_servers=127.10.189.212:39793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--inject_latency_ms_before_starting_op=1000 with env {}
W20260806 15:55:32.111209 14372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:55:32.111510 14372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:55:32.111590 14372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:55:32.115661 14372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:55:32.115800 14372 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.193
I20260806 15:55:32.120419 14372 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:39793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.10.189.193
--webserver_port=0
--inject_latency_ms_before_starting_op=1000
--tserver_master_addrs=127.10.189.254:39723
--never_fsync=true
--heap_profile_path=/tmp/kudu.14372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.193
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:55:32.121497 14372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:55:32.122993 14372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:55:32.132597 14382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:55:32.132588 14379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:55:32.132726 14372 server_base.cc:1034] running on GCE node
W20260806 15:55:32.132589 14380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:55:32.133338 14372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:55:32.133996 14372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:55:32.135188 14372 hybrid_clock.cc:648] HybridClock initialized: now 1786031732135172 us; error 31 us; skew 500 ppm
I20260806 15:55:32.137243 14372 webserver.cc:460] Webserver started at http://127.10.189.193:46615/ using document root <none> and password file <none>
I20260806 15:55:32.137832 14372 fs_manager.cc:359] Metadata directory not provided
I20260806 15:55:32.137926 14372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:55:32.138216 14372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:55:32.140166 14372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "1f69271e143c4b0baa12386105c8064c"
format_stamp: "Formatted at 2026-08-06 15:55:32 on dist-test-slave-mn4r"
I20260806 15:55:32.140738 14372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "1f69271e143c4b0baa12386105c8064c"
format_stamp: "Formatted at 2026-08-06 15:55:32 on dist-test-slave-mn4r"
I20260806 15:55:32.144737 14372 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 15:55:32.147157 14389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:55:32.148430 14372 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 15:55:32.148583 14372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "1f69271e143c4b0baa12386105c8064c"
format_stamp: "Formatted at 2026-08-06 15:55:32 on dist-test-slave-mn4r"
I20260806 15:55:32.148692 14372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:55:32.174715 14372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:55:32.175560 14372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:55:32.175782 14372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:55:32.176425 14372 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:55:32.177431 14372 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:55:32.177505 14372 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:55:32.177578 14372 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:55:32.177621 14372 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:55:32.186381 14372 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.193:38953
I20260806 15:55:32.186419 14507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.193:38953 every 8 connection(s)
I20260806 15:55:32.187284 14372 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260806 15:55:32.195480 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 14372
I20260806 15:55:32.195627 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260806 15:55:32.198027 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.194:0
--local_ip_for_outbound_sockets=127.10.189.194
--webserver_interface=127.10.189.194
--webserver_port=0
--tserver_master_addrs=127.10.189.254:39723
--builtin_ntp_servers=127.10.189.212:39793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--inject_latency_ms_before_starting_op=1000 with env {}
I20260806 15:55:32.198051 14508 heartbeater.cc:347] Connected to a master server at 127.10.189.254:39723
I20260806 15:55:32.198329 14508 heartbeater.cc:464] Registering TS with master...
I20260806 15:55:32.198828 14508 heartbeater.cc:511] Master 127.10.189.254:39723 requested a full tablet report, sending...
I20260806 15:55:32.200430 14311 ts_manager.cc:194] Registered new tserver with Master: 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953)
I20260806 15:55:32.201633 14311 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.193:41385
W20260806 15:55:32.308158 14511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:55:32.308432 14511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:55:32.308508 14511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:55:32.312584 14511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:55:32.312723 14511 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.194
I20260806 15:55:32.317399 14511 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:39793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.10.189.194
--webserver_port=0
--inject_latency_ms_before_starting_op=1000
--tserver_master_addrs=127.10.189.254:39723
--never_fsync=true
--heap_profile_path=/tmp/kudu.14511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.194
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:55:32.318430 14511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:55:32.319811 14511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:55:32.329406 14519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:55:32.329442 14516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:55:32.329437 14517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:55:32.329519 14511 server_base.cc:1034] running on GCE node
I20260806 15:55:32.330057 14511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:55:32.330780 14511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:55:32.331962 14511 hybrid_clock.cc:648] HybridClock initialized: now 1786031732331928 us; error 46 us; skew 500 ppm
I20260806 15:55:32.333866 14511 webserver.cc:460] Webserver started at http://127.10.189.194:46703/ using document root <none> and password file <none>
I20260806 15:55:32.334511 14511 fs_manager.cc:359] Metadata directory not provided
I20260806 15:55:32.334576 14511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:55:32.334832 14511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:55:32.336906 14511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "f6de0c8fde1149d09d735226abe0a9e1"
format_stamp: "Formatted at 2026-08-06 15:55:32 on dist-test-slave-mn4r"
I20260806 15:55:32.337517 14511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "f6de0c8fde1149d09d735226abe0a9e1"
format_stamp: "Formatted at 2026-08-06 15:55:32 on dist-test-slave-mn4r"
I20260806 15:55:32.341250 14511 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260806 15:55:32.343822 14526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:55:32.345257 14511 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 15:55:32.345400 14511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "f6de0c8fde1149d09d735226abe0a9e1"
format_stamp: "Formatted at 2026-08-06 15:55:32 on dist-test-slave-mn4r"
I20260806 15:55:32.345516 14511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:55:32.372116 14511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:55:32.372851 14511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:55:32.373065 14511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:55:32.373703 14511 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:55:32.374768 14511 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:55:32.374819 14511 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:55:32.374888 14511 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:55:32.374935 14511 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:55:32.383598 14511 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.194:37079
I20260806 15:55:32.383622 14645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.194:37079 every 8 connection(s)
I20260806 15:55:32.384543 14511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260806 15:55:32.384939 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 14511
I20260806 15:55:32.385079 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260806 15:55:32.387673 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.195:0
--local_ip_for_outbound_sockets=127.10.189.195
--webserver_interface=127.10.189.195
--webserver_port=0
--tserver_master_addrs=127.10.189.254:39723
--builtin_ntp_servers=127.10.189.212:39793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--inject_latency_ms_before_starting_op=1000 with env {}
I20260806 15:55:32.396979 14646 heartbeater.cc:347] Connected to a master server at 127.10.189.254:39723
I20260806 15:55:32.397233 14646 heartbeater.cc:464] Registering TS with master...
I20260806 15:55:32.397778 14646 heartbeater.cc:511] Master 127.10.189.254:39723 requested a full tablet report, sending...
I20260806 15:55:32.398963 14311 ts_manager.cc:194] Registered new tserver with Master: f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079)
I20260806 15:55:32.399546 14311 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.194:45805
W20260806 15:55:32.503001 14649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:55:32.503269 14649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:55:32.503331 14649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:55:32.508067 14649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:55:32.508220 14649 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.195
I20260806 15:55:32.513586 14649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:39793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.189.195
--webserver_port=0
--inject_latency_ms_before_starting_op=1000
--tserver_master_addrs=127.10.189.254:39723
--never_fsync=true
--heap_profile_path=/tmp/kudu.14649
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.195
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:55:32.514849 14649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:55:32.516316 14649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:55:32.526196 14654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:55:32.526183 14657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:55:32.526304 14649 server_base.cc:1034] running on GCE node
W20260806 15:55:32.526183 14655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:55:32.526870 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:55:32.527535 14649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:55:32.528739 14649 hybrid_clock.cc:648] HybridClock initialized: now 1786031732528703 us; error 47 us; skew 500 ppm
I20260806 15:55:32.530869 14649 webserver.cc:460] Webserver started at http://127.10.189.195:36285/ using document root <none> and password file <none>
I20260806 15:55:32.531483 14649 fs_manager.cc:359] Metadata directory not provided
I20260806 15:55:32.531580 14649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:55:32.531817 14649 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:55:32.534042 14649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "90e80c401c894ab2bc7a4d60ce338cbb"
format_stamp: "Formatted at 2026-08-06 15:55:32 on dist-test-slave-mn4r"
I20260806 15:55:32.534778 14649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "90e80c401c894ab2bc7a4d60ce338cbb"
format_stamp: "Formatted at 2026-08-06 15:55:32 on dist-test-slave-mn4r"
I20260806 15:55:32.538829 14649 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 15:55:32.541276 14663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:55:32.542685 14649 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 15:55:32.542824 14649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "90e80c401c894ab2bc7a4d60ce338cbb"
format_stamp: "Formatted at 2026-08-06 15:55:32 on dist-test-slave-mn4r"
I20260806 15:55:32.542999 14649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:55:32.567039 14649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:55:32.567746 14649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:55:32.567953 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:55:32.568554 14649 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:55:32.569514 14649 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:55:32.569563 14649 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:55:32.569603 14649 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:55:32.569619 14649 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:55:32.577853 14649 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.195:42369
I20260806 15:55:32.577894 14788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.195:42369 every 8 connection(s)
I20260806 15:55:32.578828 14649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260806 15:55:32.585209 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 14649
I20260806 15:55:32.585323 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260806 15:55:32.589365 14789 heartbeater.cc:347] Connected to a master server at 127.10.189.254:39723
I20260806 15:55:32.589565 14789 heartbeater.cc:464] Registering TS with master...
I20260806 15:55:32.590040 14789 heartbeater.cc:511] Master 127.10.189.254:39723 requested a full tablet report, sending...
I20260806 15:55:32.591032 14311 ts_manager.cc:194] Registered new tserver with Master: 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:32.591594 14311 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.195:42175
I20260806 15:55:32.599731 10999 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:55:32.601361 10999 test_util.cc:268] Using random seed: -352669170
I20260806 15:55:32.612720 14311 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43622:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:55:32.613915 14311 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:55:32.631331 14577 tablet_service.cc:1467] Processing CreateTablet for tablet c8678de65e594defb0360c1ec12cbdbb (DEFAULT_TABLE table=test-workload [id=639d3ae76044430a841507193c8c2083]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:55:32.631455 14717 tablet_service.cc:1467] Processing CreateTablet for tablet c8678de65e594defb0360c1ec12cbdbb (DEFAULT_TABLE table=test-workload [id=639d3ae76044430a841507193c8c2083]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:55:32.631455 14439 tablet_service.cc:1467] Processing CreateTablet for tablet c8678de65e594defb0360c1ec12cbdbb (DEFAULT_TABLE table=test-workload [id=639d3ae76044430a841507193c8c2083]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:55:32.632356 14577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8678de65e594defb0360c1ec12cbdbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:55:32.632484 14439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8678de65e594defb0360c1ec12cbdbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:55:32.632484 14717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8678de65e594defb0360c1ec12cbdbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:55:32.638998 14807 tablet_bootstrap.cc:492] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb: Bootstrap starting.
I20260806 15:55:32.639864 14808 tablet_bootstrap.cc:492] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c: Bootstrap starting.
I20260806 15:55:32.639864 14806 tablet_bootstrap.cc:492] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1: Bootstrap starting.
I20260806 15:55:32.641013 14807 tablet_bootstrap.cc:654] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb: Neither blocks nor log segments found. Creating new log.
I20260806 15:55:32.641731 14807 log.cc:824] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb: Log is configured to *not* fsync() on all Append() calls
I20260806 15:55:32.642021 14806 tablet_bootstrap.cc:654] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1: Neither blocks nor log segments found. Creating new log.
I20260806 15:55:32.642045 14808 tablet_bootstrap.cc:654] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c: Neither blocks nor log segments found. Creating new log.
I20260806 15:55:32.642884 14806 log.cc:824] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1: Log is configured to *not* fsync() on all Append() calls
I20260806 15:55:32.642884 14808 log.cc:824] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c: Log is configured to *not* fsync() on all Append() calls
I20260806 15:55:32.643843 14807 tablet_bootstrap.cc:492] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb: No bootstrap required, opened a new log
I20260806 15:55:32.644052 14807 ts_tablet_manager.cc:1397] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260806 15:55:32.644707 14808 tablet_bootstrap.cc:492] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c: No bootstrap required, opened a new log
I20260806 15:55:32.644707 14806 tablet_bootstrap.cc:492] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1: No bootstrap required, opened a new log
I20260806 15:55:32.644891 14808 ts_tablet_manager.cc:1397] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260806 15:55:32.644891 14806 ts_tablet_manager.cc:1397] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260806 15:55:32.647738 14807 raft_consensus.cc:348] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:32.648008 14807 raft_consensus.cc:374] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:55:32.648064 14807 raft_consensus.cc:729] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90e80c401c894ab2bc7a4d60ce338cbb, State: Initialized, Role: FOLLOWER
I20260806 15:55:32.648553 14807 consensus_queue.cc:260] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:32.649274 14789 heartbeater.cc:503] Master 127.10.189.254:39723 was elected leader, sending a full tablet report...
I20260806 15:55:32.649408 14806 raft_consensus.cc:348] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:32.649653 14806 raft_consensus.cc:374] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:55:32.649711 14806 raft_consensus.cc:729] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6de0c8fde1149d09d735226abe0a9e1, State: Initialized, Role: FOLLOWER
I20260806 15:55:32.649582 14812 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:55:32.649801 14807 ts_tablet_manager.cc:1428] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260806 15:55:32.650202 14806 consensus_queue.cc:260] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:32.649995 14812 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:32.651156 14806 ts_tablet_manager.cc:1428] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260806 15:55:32.651031 14808 raft_consensus.cc:348] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:32.651288 14808 raft_consensus.cc:374] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:55:32.651345 14808 raft_consensus.cc:729] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f69271e143c4b0baa12386105c8064c, State: Initialized, Role: FOLLOWER
I20260806 15:55:32.651528 14646 heartbeater.cc:503] Master 127.10.189.254:39723 was elected leader, sending a full tablet report...
I20260806 15:55:32.651798 14808 consensus_queue.cc:260] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:32.652777 14808 ts_tablet_manager.cc:1428] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260806 15:55:32.653108 14508 heartbeater.cc:503] Master 127.10.189.254:39723 was elected leader, sending a full tablet report...
I20260806 15:55:32.653801 14812 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079)
I20260806 15:55:32.653303 14814 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:55:32.654194 14814 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:32.655867 14816 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:55:32.655887 14814 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:32.656004 14816 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:32.657797 14816 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
W20260806 15:55:32.660249 14665 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.189.193:38953 timed out after 0.007s (SENT)
I20260806 15:55:32.662742 14460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:32.662952 14460 raft_consensus.cc:2454] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90e80c401c894ab2bc7a4d60ce338cbb in term 0.
I20260806 15:55:32.663069 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:32.663296 14737 raft_consensus.cc:2454] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6de0c8fde1149d09d735226abe0a9e1 in term 0.
I20260806 15:55:32.663307 14599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:32.663462 14599 raft_consensus.cc:2454] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90e80c401c894ab2bc7a4d60ce338cbb in term 0.
I20260806 15:55:32.663481 14460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:32.663606 14460 raft_consensus.cc:2454] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90e80c401c894ab2bc7a4d60ce338cbb in term 0.
W20260806 15:55:32.663767 14529 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.10.189.193:38953 for RPC RequestConsensusVote timed out after 0.008s (ON_OUTBOUND_QUEUE)
I20260806 15:55:32.663882 14665 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb; no voters:
I20260806 15:55:32.664125 14812 raft_consensus.cc:2781] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:55:32.664211 14812 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:55:32.664263 14812 raft_consensus.cc:3037] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:55:32.664491 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
W20260806 15:55:32.664784 14392 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.189.195:42369 timed out after 0.007s (ON_OUTBOUND_QUEUE)
I20260806 15:55:32.665475 14812 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:32.665620 14736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:32.665819 14812 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb [CANDIDATE]: Term 1 election: Requested vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079)
I20260806 15:55:32.666290 14460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c"
I20260806 15:55:32.666409 14460 raft_consensus.cc:3037] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:55:32.666433 14459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:32.666983 14599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1"
I20260806 15:55:32.667114 14599 raft_consensus.cc:3037] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:55:32.667207 14737 raft_consensus.cc:2379] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6de0c8fde1149d09d735226abe0a9e1 in current term 1: Already voted for candidate 90e80c401c894ab2bc7a4d60ce338cbb in this term.
I20260806 15:55:32.667724 14460 raft_consensus.cc:2454] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90e80c401c894ab2bc7a4d60ce338cbb in term 1.
I20260806 15:55:32.667994 14665 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb; no voters:
I20260806 15:55:32.668011 14530 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:32.668246 14599 raft_consensus.cc:2454] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90e80c401c894ab2bc7a4d60ce338cbb in term 1.
I20260806 15:55:32.668326 14814 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260806 15:55:32.668663 14812 raft_consensus.cc:2781] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:55:32.668856 14812 raft_consensus.cc:686] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb [term 1 LEADER]: Becoming Leader. State: Replica: 90e80c401c894ab2bc7a4d60ce338cbb, State: Running, Role: LEADER
I20260806 15:55:32.669160 14812 consensus_queue.cc:237] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:32.669976 14599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:32.670173 14599 raft_consensus.cc:2379] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f69271e143c4b0baa12386105c8064c in current term 1: Already voted for candidate 90e80c401c894ab2bc7a4d60ce338cbb in this term.
I20260806 15:55:32.670622 14390 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:32.670921 14815 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260806 15:55:32.672698 14828 consensus_queue.cc:1035] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:55:32.672855 14812 consensus_queue.cc:1035] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:55:32.672663 14310 catalog_manager.cc:5495] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195). New cstate: current_term: 1 leader_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } health_report { overall_health: HEALTHY } } }
W20260806 15:55:32.698832 14831 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260806 15:55:32.698918 14831 fault_injection.cc:44] THIS SERVER MAY CRASH!
W20260806 15:55:33.153553 14460 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260806 15:55:33.153553 14599 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260806 15:55:33.153635 14599 fault_injection.cc:44] THIS SERVER MAY CRASH!
W20260806 15:55:33.153635 14460 fault_injection.cc:44] THIS SERVER MAY CRASH!
I20260806 15:55:33.527372 14815 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:33.527522 14815 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:33.528339 14815 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:33.528798 14598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:33.528867 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:33.529294 14390 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:33.529505 14815 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:33.859558 14814 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:33.859694 14814 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:33.860307 14814 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:33.860772 14459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:33.861346 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:33.861853 14530 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:33.862040 14814 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:34.058554 14815 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:34.058708 14815 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:34.059288 14815 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:34.059705 14598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:34.060171 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:34.060225 14848 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=0, attempt_no=0}) took 1365 ms. Trace:
I20260806 15:55:34.060626 14392 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:34.060855 14815 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:34.060324 14848 rpcz_store.cc:276] 0806 15:55:32.694324 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:32.694366 (+ 42us) service_pool.cc:227] Handling call
0806 15:55:34.060210 (+1365844us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:33.151840 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:33.151955 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:33.151963 (+ 8us) write_op.cc:435] Acquired schema lock
0806 15:55:33.151965 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:33.152071 (+ 106us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:33.152106 (+ 35us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:33.152110 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:33.152154 (+ 44us) tablet.cc:699] Row locks acquired
0806 15:55:33.152155 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:33.152199 (+ 44us) write_op.cc:270] Start()
0806 15:55:33.981332 (+829133us) write_op.cc:276] Timestamp: P: 1786031733152160 usec, L: 0
0806 15:55:33.981335 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:55:33.981491 (+ 156us) log.cc:842] Serialized 345 byte log entry
0806 15:55:34.059555 (+ 78064us) op_driver.cc:444] REPLICATION: finished
0806 15:55:34.059777 (+ 222us) write_op.cc:301] APPLY: starting
0806 15:55:34.059798 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:34.059846 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:34.059865 (+ 19us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:34.059948 (+ 83us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:34.059980 (+ 32us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:34.059984 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:55:34.060059 (+ 75us) log.cc:842] Serialized 22 byte log entry
0806 15:55:34.060116 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:34.060128 (+ 12us) write_op.cc:454] Released schema lock
0806 15:55:34.060135 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":1792,"child_traces":[["op",{"apply.queue_time_us":167,"mutex_wait_us":78,"num_ops":1,"prepare.queue_time_us":455006,"prepare.run_cpu_time_us":703,"prepare.run_wall_time_us":829788,"raft.queue_time_us":252,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":78195,"thread_start_us":74,"threads_started":1}]]}
I20260806 15:55:34.130910 14814 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:34.131069 14814 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:34.131649 14814 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:34.131983 14459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:34.132000 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:34.132511 14529 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:34.133272 14814 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:34.517168 14814 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:34.517305 14814 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:34.517786 14814 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:34.518235 14460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:34.518489 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:34.519234 14530 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:34.520159 14814 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:35.163012 14815 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:35.163184 14815 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:35.163713 14815 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:35.164137 14598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:35.164157 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:35.164625 14390 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:35.516970 14814 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:35.517128 14814 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:35.517612 14814 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:35.518141 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:35.518535 14460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:35.518880 14855 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=3, attempt_no=0}) took 1456 ms. Trace:
I20260806 15:55:35.518962 14855 rpcz_store.cc:276] 0806 15:55:34.062666 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:34.062702 (+ 36us) service_pool.cc:227] Handling call
0806 15:55:35.518865 (+1456163us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:34.265473 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:34.265589 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:34.265593 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:34.265595 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:34.265683 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:34.265694 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:34.265696 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:34.265748 (+ 52us) tablet.cc:699] Row locks acquired
0806 15:55:34.265749 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:34.265791 (+ 42us) write_op.cc:270] Start()
0806 15:55:34.808934 (+543143us) write_op.cc:276] Timestamp: P: 1786031734265745 usec, L: 0
0806 15:55:34.808937 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:55:34.809118 (+ 181us) log.cc:842] Serialized 354 byte log entry
0806 15:55:35.518188 (+709070us) op_driver.cc:444] REPLICATION: finished
0806 15:55:35.518476 (+ 288us) write_op.cc:301] APPLY: starting
0806 15:55:35.518494 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:35.518523 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:35.518537 (+ 14us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:35.518593 (+ 56us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:35.518623 (+ 30us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:35.518632 (+ 9us) write_op.cc:312] APPLY: finished
0806 15:55:35.518694 (+ 62us) log.cc:842] Serialized 22 byte log entry
0806 15:55:35.518775 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:35.518788 (+ 13us) write_op.cc:454] Released schema lock
0806 15:55:35.518795 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":233,"num_ops":1,"prepare.queue_time_us":202320,"prepare.run_cpu_time_us":630,"prepare.run_wall_time_us":543702,"replication_time_us":709208,"thread_start_us":73,"threads_started":1}]]}
I20260806 15:55:35.519897 14529 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:35.739701 14815 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:36.152949 14814 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:36.154838 14862 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=4, attempt_no=0}) took 1634 ms. Trace:
I20260806 15:55:36.154942 14862 rpcz_store.cc:276] 0806 15:55:34.519948 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:34.520012 (+ 64us) service_pool.cc:227] Handling call
0806 15:55:36.154820 (+1634808us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:34.809191 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:34.809310 (+ 119us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:34.809317 (+ 7us) write_op.cc:435] Acquired schema lock
0806 15:55:34.809320 (+ 3us) tablet.cc:660] Decoding operations
0806 15:55:34.809408 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:34.809418 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:34.809421 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:34.809464 (+ 43us) tablet.cc:699] Row locks acquired
0806 15:55:34.809465 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:34.809511 (+ 46us) write_op.cc:270] Start()
0806 15:55:35.399707 (+590196us) write_op.cc:276] Timestamp: P: 1786031734809465 usec, L: 0
0806 15:55:35.399714 (+ 7us) op_driver.cc:331] REPLICATION: starting
0806 15:55:35.400013 (+ 299us) log.cc:842] Serialized 354 byte log entry
0806 15:55:36.154133 (+754120us) op_driver.cc:444] REPLICATION: finished
0806 15:55:36.154391 (+ 258us) write_op.cc:301] APPLY: starting
0806 15:55:36.154412 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:36.154447 (+ 35us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:36.154471 (+ 24us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:36.154540 (+ 69us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:36.154568 (+ 28us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:36.154571 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:36.154653 (+ 82us) log.cc:842] Serialized 22 byte log entry
0806 15:55:36.154727 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:36.154739 (+ 12us) write_op.cc:454] Released schema lock
0806 15:55:36.154745 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":195,"num_ops":1,"prepare.queue_time_us":288750,"prepare.run_cpu_time_us":818,"prepare.run_wall_time_us":590888,"replication_time_us":754394,"thread_start_us":84,"threads_started":1}]]}
I20260806 15:55:36.495070 14815 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:36.495250 14815 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:36.495803 14815 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:36.496261 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:36.496268 14598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:36.496760 14390 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:36.592799 14814 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:36.592980 14814 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:36.593530 14814 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:36.593927 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:36.594048 14460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:36.594532 14529 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:36.594764 14814 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:36.594764 14862 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=5, attempt_no=0}) took 1074 ms. Trace:
I20260806 15:55:36.594828 14862 rpcz_store.cc:276] 0806 15:55:35.520523 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:35.520582 (+ 59us) service_pool.cc:227] Handling call
0806 15:55:36.594752 (+1074170us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:35.520934 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:35.521014 (+ 80us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:35.521017 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:55:35.521018 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:35.521073 (+ 55us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:35.521079 (+ 6us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:35.521081 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:35.521108 (+ 27us) tablet.cc:699] Row locks acquired
0806 15:55:35.521109 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:35.521134 (+ 25us) write_op.cc:270] Start()
0806 15:55:35.949277 (+428143us) write_op.cc:276] Timestamp: P: 1786031735521069 usec, L: 0
0806 15:55:35.949280 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:55:35.949498 (+ 218us) log.cc:842] Serialized 354 byte log entry
0806 15:55:36.594119 (+644621us) op_driver.cc:444] REPLICATION: finished
0806 15:55:36.594226 (+ 107us) write_op.cc:301] APPLY: starting
0806 15:55:36.594241 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:36.594267 (+ 26us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:36.594281 (+ 14us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:36.594335 (+ 54us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:36.594383 (+ 48us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:36.594390 (+ 7us) write_op.cc:312] APPLY: finished
0806 15:55:36.594453 (+ 63us) log.cc:842] Serialized 22 byte log entry
0806 15:55:36.594672 (+ 219us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:36.594683 (+ 11us) write_op.cc:454] Released schema lock
0806 15:55:36.594688 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":65,"num_ops":1,"prepare.queue_time_us":50,"prepare.run_cpu_time_us":558,"prepare.run_wall_time_us":428622,"replication_time_us":644815}]]}
I20260806 15:55:36.935947 14814 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:36.936105 14814 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:36.936663 14814 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:36.937129 14460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:36.937652 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:36.938145 14530 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:37.000653 14815 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:37.551229 14814 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:37.884270 14815 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:37.884459 14815 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:37.884933 14815 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:37.885335 14598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:37.885367 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:37.885879 14390 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:38.173899 14815 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:38.175688 14878 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=8, attempt_no=0}) took 1237 ms. Trace:
I20260806 15:55:38.175805 14878 rpcz_store.cc:276] 0806 15:55:36.938371 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:36.938422 (+ 51us) service_pool.cc:227] Handling call
0806 15:55:38.175670 (+1237248us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:36.938771 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:36.938839 (+ 68us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:36.938842 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:55:36.938843 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:36.938894 (+ 51us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:36.938898 (+ 4us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:36.938900 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:36.938926 (+ 26us) tablet.cc:699] Row locks acquired
0806 15:55:36.938927 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:36.938953 (+ 26us) write_op.cc:270] Start()
0806 15:55:37.613108 (+674155us) write_op.cc:276] Timestamp: P: 1786031736938900 usec, L: 0
0806 15:55:37.613112 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:37.613276 (+ 164us) log.cc:842] Serialized 354 byte log entry
0806 15:55:38.175025 (+561749us) op_driver.cc:444] REPLICATION: finished
0806 15:55:38.175295 (+ 270us) write_op.cc:301] APPLY: starting
0806 15:55:38.175312 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:38.175342 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:38.175357 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:38.175421 (+ 64us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:38.175448 (+ 27us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:38.175451 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:38.175509 (+ 58us) log.cc:842] Serialized 22 byte log entry
0806 15:55:38.175581 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:38.175593 (+ 12us) write_op.cc:454] Released schema lock
0806 15:55:38.175599 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":189,"num_ops":1,"prepare.queue_time_us":46,"prepare.run_cpu_time_us":527,"prepare.run_wall_time_us":674603,"raft.queue_time_us":72,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":7,"replication_time_us":561887,"thread_start_us":95,"threads_started":1}]]}
I20260806 15:55:38.189767 14814 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:38.189883 14814 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:38.190423 14814 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:38.190887 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:38.191257 14460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:38.192184 14529 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:38.192478 14814 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:38.743952 14814 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:38.744100 14814 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:38.744691 14814 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:38.745075 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:38.745075 14459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:38.745590 14530 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:38.745884 14883 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=9, attempt_no=0}) took 1191 ms. Trace:
I20260806 15:55:38.745970 14883 rpcz_store.cc:276] 0806 15:55:37.554044 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:37.554156 (+ 112us) service_pool.cc:227] Handling call
0806 15:55:38.745870 (+1191714us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:37.613406 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:37.613550 (+ 144us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:37.613555 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:55:37.613556 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:37.613638 (+ 82us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:37.613646 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:37.613649 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:37.613695 (+ 46us) tablet.cc:699] Row locks acquired
0806 15:55:37.613696 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:37.613757 (+ 61us) write_op.cc:270] Start()
0806 15:55:38.439885 (+826128us) write_op.cc:276] Timestamp: P: 1786031737613684 usec, L: 0
0806 15:55:38.439889 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:38.440066 (+ 177us) log.cc:842] Serialized 354 byte log entry
0806 15:55:38.745098 (+305032us) op_driver.cc:444] REPLICATION: finished
0806 15:55:38.745514 (+ 416us) write_op.cc:301] APPLY: starting
0806 15:55:38.745530 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:38.745566 (+ 36us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:38.745579 (+ 13us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:38.745648 (+ 69us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:38.745678 (+ 30us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:38.745686 (+ 8us) write_op.cc:312] APPLY: finished
0806 15:55:38.745748 (+ 62us) log.cc:842] Serialized 22 byte log entry
0806 15:55:38.745793 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:38.745803 (+ 10us) write_op.cc:454] Released schema lock
0806 15:55:38.745807 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":205,"num_ops":1,"prepare.queue_time_us":58861,"prepare.run_cpu_time_us":657,"prepare.run_wall_time_us":826714,"replication_time_us":305184,"thread_start_us":88,"threads_started":1}]]}
I20260806 15:55:39.327390 14815 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:39.327581 14815 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:39.328155 14815 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:39.328601 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:39.328632 14598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:39.329077 14390 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:39.697640 14814 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:39.699350 14891 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=10, attempt_no=0}) took 1522 ms. Trace:
I20260806 15:55:39.699465 14891 rpcz_store.cc:276] 0806 15:55:38.177275 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:38.177346 (+ 71us) service_pool.cc:227] Handling call
0806 15:55:39.699334 (+1521988us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:38.440146 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:38.440260 (+ 114us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:38.440285 (+ 25us) write_op.cc:435] Acquired schema lock
0806 15:55:38.440286 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:38.440375 (+ 89us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:38.440384 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:38.440388 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:38.440431 (+ 43us) tablet.cc:699] Row locks acquired
0806 15:55:38.440433 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:55:38.440479 (+ 46us) write_op.cc:270] Start()
0806 15:55:38.504640 (+ 64161us) write_op.cc:276] Timestamp: P: 1786031738440427 usec, L: 0
0806 15:55:38.504643 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:55:38.504907 (+ 264us) log.cc:842] Serialized 354 byte log entry
0806 15:55:39.698688 (+1193781us) op_driver.cc:444] REPLICATION: finished
0806 15:55:39.698947 (+ 259us) write_op.cc:301] APPLY: starting
0806 15:55:39.698963 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:39.698993 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:39.699008 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:39.699067 (+ 59us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:39.699098 (+ 31us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:39.699101 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:39.699154 (+ 53us) log.cc:842] Serialized 22 byte log entry
0806 15:55:39.699249 (+ 95us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:39.699259 (+ 10us) write_op.cc:454] Released schema lock
0806 15:55:39.699264 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":209,"num_ops":1,"prepare.queue_time_us":262441,"prepare.run_cpu_time_us":774,"prepare.run_wall_time_us":64840,"replication_time_us":1194025,"thread_start_us":94,"threads_started":1}]]}
I20260806 15:55:40.070322 14814 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:40.070505 14814 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:40.071133 14814 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:40.071555 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:40.071607 14459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:40.071929 14891 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=11, attempt_no=0}) took 1324 ms. Trace:
I20260806 15:55:40.072222 14529 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:40.072080 14891 rpcz_store.cc:276] 0806 15:55:38.747281 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:38.747353 (+ 72us) service_pool.cc:227] Handling call
0806 15:55:40.071916 (+1324563us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:38.747749 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:38.747824 (+ 75us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:38.747827 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:55:38.747828 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:38.747881 (+ 53us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:38.747886 (+ 5us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:38.747888 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:38.747914 (+ 26us) tablet.cc:699] Row locks acquired
0806 15:55:38.747915 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:38.747948 (+ 33us) write_op.cc:270] Start()
0806 15:55:39.133129 (+385181us) write_op.cc:276] Timestamp: P: 1786031738747913 usec, L: 0
0806 15:55:39.133134 (+ 5us) op_driver.cc:331] REPLICATION: starting
0806 15:55:39.133394 (+ 260us) log.cc:842] Serialized 354 byte log entry
0806 15:55:40.071427 (+938033us) op_driver.cc:444] REPLICATION: finished
0806 15:55:40.071532 (+ 105us) write_op.cc:301] APPLY: starting
0806 15:55:40.071548 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:40.071578 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:40.071591 (+ 13us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:40.071655 (+ 64us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:40.071686 (+ 31us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:40.071691 (+ 5us) write_op.cc:312] APPLY: finished
0806 15:55:40.071757 (+ 66us) log.cc:842] Serialized 22 byte log entry
0806 15:55:40.071816 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:40.071829 (+ 13us) write_op.cc:454] Released schema lock
0806 15:55:40.071833 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":59,"num_ops":1,"prepare.queue_time_us":70,"prepare.run_cpu_time_us":631,"prepare.run_wall_time_us":385707,"replication_time_us":938269}]]}
I20260806 15:55:40.842046 14814 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:40.844516 14898 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=12, attempt_no=0}) took 1143 ms. Trace:
I20260806 15:55:40.844609 14898 rpcz_store.cc:276] 0806 15:55:39.700820 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:39.700899 (+ 79us) service_pool.cc:227] Handling call
0806 15:55:40.844497 (+1143598us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:39.701418 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:39.701491 (+ 73us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:39.701493 (+ 2us) write_op.cc:435] Acquired schema lock
0806 15:55:39.701494 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:39.701547 (+ 53us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:39.701553 (+ 6us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:39.701554 (+ 1us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:39.701589 (+ 35us) tablet.cc:699] Row locks acquired
0806 15:55:39.701590 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:39.701616 (+ 26us) write_op.cc:270] Start()
0806 15:55:39.780774 (+ 79158us) write_op.cc:276] Timestamp: P: 1786031739701593 usec, L: 0
0806 15:55:39.780778 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:39.780986 (+ 208us) log.cc:842] Serialized 354 byte log entry
0806 15:55:40.843227 (+1062241us) op_driver.cc:444] REPLICATION: finished
0806 15:55:40.843451 (+ 224us) write_op.cc:301] APPLY: starting
0806 15:55:40.843469 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:40.843497 (+ 28us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:40.843514 (+ 17us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:40.843630 (+ 116us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:40.843652 (+ 22us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:40.843655 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:40.843837 (+ 182us) log.cc:842] Serialized 43 byte log entry
0806 15:55:40.843890 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:40.843902 (+ 12us) write_op.cc:454] Released schema lock
0806 15:55:40.843907 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":165,"num_ops":1,"prepare.queue_time_us":156,"prepare.run_cpu_time_us":561,"prepare.run_wall_time_us":79627,"replication_time_us":1062408,"thread_start_us":146,"threads_started":2}]]}
I20260806 15:55:40.861907 14815 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:40.862356 14460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.189.195:51177 (request call id 1205) took 1533 ms. Trace:
I20260806 15:55:40.862454 14460 rpcz_store.cc:276] 0806 15:55:39.328925 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:39.329004 (+ 79us) service_pool.cc:227] Handling call
0806 15:55:39.329172 (+ 168us) raft_consensus.cc:1457] Updating replica for 2 ops
0806 15:55:39.329273 (+ 101us) raft_consensus.cc:1520] Early marking committed up to index 11
0806 15:55:39.329415 (+ 142us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0806 15:55:39.329529 (+ 114us) write_op.cc:270] Start()
0806 15:55:40.199658 (+870129us) write_op.cc:276] Timestamp: P: 1786031738440427 usec, L: 0
0806 15:55:40.200000 (+ 342us) write_op.cc:270] Start()
0806 15:55:40.861185 (+661185us) write_op.cc:276] Timestamp: P: 1786031738747913 usec, L: 0
0806 15:55:40.861613 (+ 428us) log.cc:842] Serialized 708 byte log entry
0806 15:55:40.861766 (+ 153us) raft_consensus.cc:1631] Marking committed up to 11
0806 15:55:40.861774 (+ 8us) raft_consensus.cc:1683] Filling consensus response to leader.
0806 15:55:40.861808 (+ 34us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0806 15:55:40.862282 (+ 474us) raft_consensus.cc:1671] finished
0806 15:55:40.862284 (+ 2us) raft_consensus.cc:1677] UpdateReplicas() finished
0806 15:55:40.862339 (+ 55us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:40.200030 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:40.200175 (+ 145us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:40.200180 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:55:40.200181 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:40.200248 (+ 67us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:40.200259 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:40.200261 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:40.200296 (+ 35us) tablet.cc:699] Row locks acquired
0806 15:55:40.200297 (+ 1us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0806 15:55:40.861553 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:40.861652 (+ 99us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:40.861656 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:40.861657 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:40.861734 (+ 77us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:40.861743 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:40.861745 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:40.861781 (+ 36us) tablet.cc:699] Row locks acquired
0806 15:55:40.861781 (+ 0us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":100,"threads_started":1,"wal-append.queue_time_us":161,"child_traces":[["op",{"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":247,"prepare.run_cpu_time_us":334,"prepare.run_wall_time_us":335,"thread_start_us":120,"threads_started":1}],["op",{"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":236,"prepare.run_cpu_time_us":380,"prepare.run_wall_time_us":380,"thread_start_us":107,"threads_started":1}]]}
I20260806 15:55:40.889825 14814 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:40.889955 14814 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:40.890524 14814 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:40.890908 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:40.891064 14459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:40.891610 14529 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:40.891934 14814 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:41.462193 14814 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:41.462356 14814 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:41.462970 14814 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:41.463384 14459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:41.463413 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:41.464248 14530 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:41.464645 14814 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:42.265215 14815 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:42.265372 14815 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:42.265549 14460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.189.195:51177 (request call id 1206) took 1401 ms. Trace:
I20260806 15:55:42.265868 14815 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:42.265652 14460 rpcz_store.cc:276] 0806 15:55:40.864194 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:40.864264 (+ 70us) service_pool.cc:227] Handling call
0806 15:55:40.864413 (+ 149us) raft_consensus.cc:1457] Updating replica for 2 ops
0806 15:55:40.864475 (+ 62us) raft_consensus.cc:1520] Early marking committed up to index 13
0806 15:55:40.864686 (+ 211us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0806 15:55:40.864783 (+ 97us) write_op.cc:270] Start()
0806 15:55:41.803961 (+939178us) write_op.cc:276] Timestamp: P: 1786031739701593 usec, L: 0
0806 15:55:41.804271 (+ 310us) write_op.cc:270] Start()
0806 15:55:42.264454 (+460183us) write_op.cc:276] Timestamp: P: 1786031740074434 usec, L: 0
0806 15:55:42.264818 (+ 364us) log.cc:842] Serialized 708 byte log entry
0806 15:55:42.265004 (+ 186us) raft_consensus.cc:1631] Marking committed up to 14
0806 15:55:42.265137 (+ 133us) raft_consensus.cc:1683] Filling consensus response to leader.
0806 15:55:42.265171 (+ 34us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0806 15:55:42.265476 (+ 305us) raft_consensus.cc:1671] finished
0806 15:55:42.265478 (+ 2us) raft_consensus.cc:1677] UpdateReplicas() finished
0806 15:55:42.265529 (+ 51us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:41.804306 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:41.804441 (+ 135us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:41.804446 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:55:41.804448 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:41.804528 (+ 80us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:41.804541 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:41.804544 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:41.804589 (+ 45us) tablet.cc:699] Row locks acquired
0806 15:55:41.804591 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:55:42.265037 (+460446us) op_driver.cc:444] REPLICATION: finished
0806 15:55:42.265261 (+ 224us) write_op.cc:301] APPLY: starting
0806 15:55:42.265277 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:42.265307 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:42.265308 (+ 1us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:42.265459 (+ 151us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:42.265491 (+ 32us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:42.265517 (+ 26us) write_op.cc:312] APPLY: finished
0806 15:55:42.265686 (+ 169us) log.cc:842] Serialized 43 byte log entry
0806 15:55:42.265738 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
Related trace 'op':
0806 15:55:42.264696 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:42.264803 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:42.264808 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:55:42.264809 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:42.264879 (+ 70us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:42.264890 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:42.264893 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:42.264935 (+ 42us) tablet.cc:699] Row locks acquired
0806 15:55:42.264936 (+ 1us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":112,"threads_started":1,"wal-append.queue_time_us":192,"child_traces":[["op",{"apply.queue_time_us":169,"num_ops":1,"partition_lock_wait_us":6,"prepare.queue_time_us":219,"prepare.run_cpu_time_us":365,"prepare.run_wall_time_us":364,"replication_time_us":1400240,"thread_start_us":134,"threads_started":2}],["op",{"num_ops":1,"partition_lock_wait_us":6,"prepare.queue_time_us":85,"prepare.run_cpu_time_us":324,"prepare.run_wall_time_us":325}]]}
I20260806 15:55:42.266623 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:42.266634 14598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:42.267129 14390 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:42.267393 14815 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:42.835474 14909 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:42.835628 14909 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:42.836190 14909 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:42.836678 14459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:42.836699 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:42.837229 14529 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:42.837776 14916 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=15, attempt_no=0}) took 1944 ms. Trace:
I20260806 15:55:42.837854 14916 rpcz_store.cc:276] 0806 15:55:40.893187 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:40.893256 (+ 69us) service_pool.cc:227] Handling call
0806 15:55:42.837762 (+1944506us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:41.256603 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:41.256709 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:41.256713 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:41.256715 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:41.256795 (+ 80us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:41.256812 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:41.256815 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:41.256905 (+ 90us) tablet.cc:699] Row locks acquired
0806 15:55:41.256906 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:41.256954 (+ 48us) write_op.cc:270] Start()
0806 15:55:42.201100 (+944146us) write_op.cc:276] Timestamp: P: 1786031741256916 usec, L: 0
0806 15:55:42.201104 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:42.201307 (+ 203us) log.cc:842] Serialized 354 byte log entry
0806 15:55:42.836913 (+635606us) op_driver.cc:444] REPLICATION: finished
0806 15:55:42.837155 (+ 242us) write_op.cc:301] APPLY: starting
0806 15:55:42.837173 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:42.837257 (+ 84us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:42.837272 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:42.837329 (+ 57us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:42.837356 (+ 27us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:42.837360 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:55:42.837432 (+ 72us) log.cc:842] Serialized 43 byte log entry
0806 15:55:42.837659 (+ 227us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:42.837671 (+ 12us) write_op.cc:454] Released schema lock
0806 15:55:42.837676 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":191,"num_ops":1,"prepare.queue_time_us":363037,"prepare.run_cpu_time_us":725,"prepare.run_wall_time_us":944798,"raft.queue_time_us":42,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":124,"replication_time_us":635787,"spinlock_wait_cycles":82304,"thread_start_us":54,"threads_started":1}]]}
I20260806 15:55:42.876461 14909 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:42.877976 14916 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=16, attempt_no=0}) took 1412 ms. Trace:
I20260806 15:55:42.878085 14916 rpcz_store.cc:276] 0806 15:55:41.465531 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:41.465600 (+ 69us) service_pool.cc:227] Handling call
0806 15:55:42.877963 (+1412363us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:42.201424 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:42.201524 (+ 100us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:42.201530 (+ 6us) write_op.cc:435] Acquired schema lock
0806 15:55:42.201533 (+ 3us) tablet.cc:660] Decoding operations
0806 15:55:42.201604 (+ 71us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:42.201615 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:42.201617 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:42.201659 (+ 42us) tablet.cc:699] Row locks acquired
0806 15:55:42.201660 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:42.201699 (+ 39us) write_op.cc:270] Start()
0806 15:55:42.672892 (+471193us) write_op.cc:276] Timestamp: P: 1786031742201629 usec, L: 0
0806 15:55:42.672904 (+ 12us) op_driver.cc:331] REPLICATION: starting
0806 15:55:42.673138 (+ 234us) log.cc:842] Serialized 354 byte log entry
0806 15:55:42.877413 (+204275us) op_driver.cc:444] REPLICATION: finished
0806 15:55:42.877555 (+ 142us) write_op.cc:301] APPLY: starting
0806 15:55:42.877571 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:42.877597 (+ 26us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:42.877614 (+ 17us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:42.877698 (+ 84us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:42.877725 (+ 27us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:42.877731 (+ 6us) write_op.cc:312] APPLY: finished
0806 15:55:42.877810 (+ 79us) log.cc:842] Serialized 43 byte log entry
0806 15:55:42.877871 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:42.877880 (+ 9us) write_op.cc:454] Released schema lock
0806 15:55:42.877884 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":61,"num_ops":1,"prepare.queue_time_us":735348,"prepare.run_cpu_time_us":690,"prepare.run_wall_time_us":471777,"replication_time_us":204484}]]}
I20260806 15:55:43.057178 14815 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:43.057300 14815 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:43.057781 14815 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:43.058254 14599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:43.058580 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:43.059243 14392 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:43.059496 14815 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:43.785207 14815 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:43.785352 14815 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:43.785909 14815 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:43.786273 14599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 18 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:43.786343 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 18 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:43.786921 14392 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:43.787139 14815 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:43.996243 14815 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:43.996418 14815 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:43.996992 14815 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:43.997449 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 19 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:43.997454 14598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 19 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:43.997925 14390 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:43.998298 14924 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=17, attempt_no=0}) took 1159 ms. Trace:
I20260806 15:55:43.998407 14924 rpcz_store.cc:276] 0806 15:55:42.839280 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:42.839316 (+ 36us) service_pool.cc:227] Handling call
0806 15:55:43.998284 (+1158968us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:42.839664 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:42.839739 (+ 75us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:42.839741 (+ 2us) write_op.cc:435] Acquired schema lock
0806 15:55:42.839742 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:42.839798 (+ 56us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:42.839803 (+ 5us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:42.839805 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:42.839834 (+ 29us) tablet.cc:699] Row locks acquired
0806 15:55:42.839835 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:42.839862 (+ 27us) write_op.cc:270] Start()
0806 15:55:43.816997 (+977135us) write_op.cc:276] Timestamp: P: 1786031742839841 usec, L: 0
0806 15:55:43.817000 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:55:43.817188 (+ 188us) log.cc:842] Serialized 354 byte log entry
0806 15:55:43.997516 (+180328us) op_driver.cc:444] REPLICATION: finished
0806 15:55:43.997766 (+ 250us) write_op.cc:301] APPLY: starting
0806 15:55:43.997782 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:43.997811 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:43.997827 (+ 16us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:43.997883 (+ 56us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:43.997914 (+ 31us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:43.997918 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:55:43.997984 (+ 66us) log.cc:842] Serialized 22 byte log entry
0806 15:55:43.998040 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:43.998222 (+ 182us) write_op.cc:454] Released schema lock
0806 15:55:43.998227 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":202,"num_ops":1,"prepare.queue_time_us":47,"prepare.run_cpu_time_us":528,"prepare.run_wall_time_us":977602,"raft.queue_time_us":192,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":180493,"thread_start_us":91,"threads_started":1}]]}
I20260806 15:55:43.998633 14815 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:44.212903 14923 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:44.213037 14923 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:44.213647 14923 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:44.214069 14460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 19 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:44.214036 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 19 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:44.214658 14529 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:44.215060 14923 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:44.494658 14923 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:44.494820 14923 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:44.495484 14923 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:44.495981 14460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 20 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:44.496362 14924 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=18, attempt_no=0}) took 1616 ms. Trace:
I20260806 15:55:44.496407 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 20 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:44.496446 14924 rpcz_store.cc:276] 0806 15:55:42.879519 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:42.879580 (+ 61us) service_pool.cc:227] Handling call
0806 15:55:44.496349 (+1616769us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:43.817294 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:43.817394 (+ 100us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:43.817398 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:43.817400 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:43.817492 (+ 92us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:43.817501 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:43.817503 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:43.998152 (+180649us) lock_manager.cc:599] Waited 180450us for lock on <redacted> (key hash 18178737835805687895)
0806 15:55:43.998160 (+ 8us) tablet.cc:699] Row locks acquired
0806 15:55:43.998162 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:55:43.998197 (+ 35us) write_op.cc:270] Start()
0806 15:55:44.336338 (+338141us) write_op.cc:276] Timestamp: P: 1786031743998156 usec, L: 0
0806 15:55:44.336343 (+ 5us) op_driver.cc:331] REPLICATION: starting
0806 15:55:44.336548 (+ 205us) log.cc:842] Serialized 354 byte log entry
0806 15:55:44.495810 (+159262us) op_driver.cc:444] REPLICATION: finished
0806 15:55:44.495910 (+ 100us) write_op.cc:301] APPLY: starting
0806 15:55:44.495939 (+ 29us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:44.495969 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:44.495970 (+ 1us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:44.496035 (+ 65us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:44.496062 (+ 27us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:44.496066 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:55:44.496178 (+ 112us) log.cc:842] Serialized 43 byte log entry
0806 15:55:44.496239 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:44.496253 (+ 14us) write_op.cc:454] Released schema lock
0806 15:55:44.496259 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":31,"num_ops":1,"prepare.queue_time_us":937446,"prepare.run_cpu_time_us":916,"prepare.run_wall_time_us":519392,"raft.queue_time_us":95,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":159441,"row_lock_wait_count":1,"row_lock_wait_us":180450,"spinlock_wait_cycles":104704}]]}
I20260806 15:55:44.496959 14530 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:44.497148 14923 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:44.800055 14815 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:44.800194 14815 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:44.800696 14815 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:44.801136 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 20 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:44.801057 14599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 20 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:44.801914 14390 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:44.802241 14815 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:45.426376 14930 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:45.426532 14930 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:45.427143 14930 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:45.427614 14460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 21 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:45.427630 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 21 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:45.428110 14530 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:45.428221 14932 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=19, attempt_no=0}) took 1428 ms. Trace:
I20260806 15:55:45.428298 14930 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:45.428300 14932 rpcz_store.cc:276] 0806 15:55:43.999944 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:44.000017 (+ 73us) service_pool.cc:227] Handling call
0806 15:55:45.428206 (+1428189us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:44.336714 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:44.336818 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:44.336823 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:55:44.336825 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:44.336903 (+ 78us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:44.336913 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:44.336916 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:44.336959 (+ 43us) tablet.cc:699] Row locks acquired
0806 15:55:44.336960 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:44.337017 (+ 57us) write_op.cc:270] Start()
0806 15:55:45.200145 (+863128us) write_op.cc:276] Timestamp: P: 1786031744336988 usec, L: 0
0806 15:55:45.200149 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:45.200323 (+ 174us) log.cc:842] Serialized 354 byte log entry
0806 15:55:45.427399 (+227076us) op_driver.cc:444] REPLICATION: finished
0806 15:55:45.427650 (+ 251us) write_op.cc:301] APPLY: starting
0806 15:55:45.427666 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:45.427696 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:45.427711 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:45.427771 (+ 60us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:45.427796 (+ 25us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:45.427800 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:55:45.428018 (+ 218us) log.cc:842] Serialized 43 byte log entry
0806 15:55:45.428102 (+ 84us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:45.428114 (+ 12us) write_op.cc:454] Released schema lock
0806 15:55:45.428120 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":203,"num_ops":1,"prepare.queue_time_us":336337,"prepare.run_cpu_time_us":621,"prepare.run_wall_time_us":863677,"replication_time_us":227228,"thread_start_us":86,"threads_started":1}]]}
I20260806 15:55:45.825330 14815 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:45.825505 14815 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:45.826063 14815 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:45.826537 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 21 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:45.826597 14599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 21 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:45.827045 14390 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:46.072023 14930 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:46.072168 14930 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:46.072685 14930 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:46.073134 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 22 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:46.073139 14460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 22 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:46.073697 14530 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:46.073863 14930 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:46.074632 14939 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=20, attempt_no=0}) took 1576 ms. Trace:
I20260806 15:55:46.074717 14939 rpcz_store.cc:276] 0806 15:55:44.497930 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:44.497976 (+ 46us) service_pool.cc:227] Handling call
0806 15:55:46.074606 (+1576630us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:45.200431 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:45.200534 (+ 103us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:45.200538 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:45.200540 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:45.200620 (+ 80us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:45.200671 (+ 51us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:45.200676 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:45.200721 (+ 45us) tablet.cc:699] Row locks acquired
0806 15:55:45.200722 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:45.200757 (+ 35us) write_op.cc:270] Start()
0806 15:55:45.655909 (+455152us) write_op.cc:276] Timestamp: P: 1786031745200704 usec, L: 0
0806 15:55:45.655913 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:45.656124 (+ 211us) log.cc:842] Serialized 354 byte log entry
0806 15:55:46.073968 (+417844us) op_driver.cc:444] REPLICATION: finished
0806 15:55:46.074203 (+ 235us) write_op.cc:301] APPLY: starting
0806 15:55:46.074218 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:46.074243 (+ 25us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:46.074255 (+ 12us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:46.074301 (+ 46us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:46.074362 (+ 61us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:46.074366 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:55:46.074451 (+ 85us) log.cc:842] Serialized 22 byte log entry
0806 15:55:46.074519 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:46.074532 (+ 13us) write_op.cc:454] Released schema lock
0806 15:55:46.074537 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":182,"num_ops":1,"prepare.queue_time_us":702086,"prepare.run_cpu_time_us":737,"prepare.run_wall_time_us":455761,"replication_time_us":418032,"thread_start_us":102,"threads_started":1}]]}
I20260806 15:55:46.360961 14815 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:46.533385 14930 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:46.533533 14930 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:46.534063 14930 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:46.534540 14460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 23 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:46.535597 14939 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=21, attempt_no=0}) took 1105 ms. Trace:
I20260806 15:55:46.534440 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 23 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:46.535677 14939 rpcz_store.cc:276] 0806 15:55:45.429677 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:45.429739 (+ 62us) service_pool.cc:227] Handling call
0806 15:55:46.535585 (+1105846us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:45.656226 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:45.656332 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:45.656336 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:45.656337 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:45.656411 (+ 74us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:45.656418 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:45.656420 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:45.656476 (+ 56us) tablet.cc:699] Row locks acquired
0806 15:55:45.656478 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:55:45.656520 (+ 42us) write_op.cc:270] Start()
0806 15:55:46.433643 (+777123us) write_op.cc:276] Timestamp: P: 1786031745656475 usec, L: 0
0806 15:55:46.433645 (+ 2us) op_driver.cc:331] REPLICATION: starting
0806 15:55:46.433827 (+ 182us) log.cc:842] Serialized 354 byte log entry
0806 15:55:46.534918 (+101091us) op_driver.cc:444] REPLICATION: finished
0806 15:55:46.535155 (+ 237us) write_op.cc:301] APPLY: starting
0806 15:55:46.535174 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:46.535208 (+ 34us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:46.535223 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:46.535284 (+ 61us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:46.535315 (+ 31us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:46.535322 (+ 7us) write_op.cc:312] APPLY: finished
0806 15:55:46.535426 (+ 104us) log.cc:842] Serialized 43 byte log entry
0806 15:55:46.535485 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:46.535496 (+ 11us) write_op.cc:454] Released schema lock
0806 15:55:46.535501 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":173,"mutex_wait_us":17,"num_ops":1,"prepare.queue_time_us":226187,"prepare.run_cpu_time_us":665,"prepare.run_wall_time_us":777719,"raft.queue_time_us":234,"raft.run_cpu_time_us":485,"raft.run_wall_time_us":486,"replication_time_us":100682,"spinlock_wait_cycles":150528}]]}
I20260806 15:55:46.536190 14530 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:47.168936 14930 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:47.170796 14946 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=22, attempt_no=0}) took 1094 ms. Trace:
I20260806 15:55:47.170895 14946 rpcz_store.cc:276] 0806 15:55:46.076059 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:46.076120 (+ 61us) service_pool.cc:227] Handling call
0806 15:55:47.170779 (+1094659us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:46.433994 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:46.434122 (+ 128us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:46.434126 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:46.434127 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:46.434221 (+ 94us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:46.434237 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:46.434240 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:46.434275 (+ 35us) tablet.cc:699] Row locks acquired
0806 15:55:46.434276 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:46.434334 (+ 58us) write_op.cc:270] Start()
0806 15:55:46.530480 (+ 96146us) write_op.cc:276] Timestamp: P: 1786031746434311 usec, L: 0
0806 15:55:46.530484 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:46.530687 (+ 203us) log.cc:842] Serialized 354 byte log entry
0806 15:55:47.170172 (+639485us) op_driver.cc:444] REPLICATION: finished
0806 15:55:47.170394 (+ 222us) write_op.cc:301] APPLY: starting
0806 15:55:47.170408 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:47.170432 (+ 24us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:47.170453 (+ 21us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:47.170505 (+ 52us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:47.170526 (+ 21us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:47.170529 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:47.170626 (+ 97us) log.cc:842] Serialized 43 byte log entry
0806 15:55:47.170679 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:47.170689 (+ 10us) write_op.cc:454] Released schema lock
0806 15:55:47.170695 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":148,"num_ops":1,"prepare.queue_time_us":357560,"prepare.run_cpu_time_us":726,"prepare.run_wall_time_us":96789,"replication_time_us":639661,"thread_start_us":72,"threads_started":1}]]}
I20260806 15:55:47.215659 14930 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:47.215791 14930 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:47.216200 14930 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:47.216686 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 25 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:47.216703 14460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 25 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:47.218178 14530 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:47.218420 14930 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:47.270749 14815 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:47.270912 14815 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:47.271481 14815 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:47.271741 14599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 23 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:47.272086 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 23 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:47.272428 14392 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:47.767990 14815 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:48.091317 14815 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:48.091498 14815 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:48.092195 14815 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:48.092604 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:48.092705 14598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:48.093214 14390 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:48.093837 14815 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:48.097620 14930 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:48.097733 14930 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:48.098359 14930 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:48.098759 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:48.098928 14459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:48.099311 14529 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:48.099478 14930 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:48.268940 14815 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:48.269099 14815 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:48.269683 14815 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:48.270071 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 27 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:48.270124 14598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 27 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:48.270645 14952 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=25, attempt_no=0}) took 1051 ms. Trace:
I20260806 15:55:48.270915 14392 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:48.270723 14952 rpcz_store.cc:276] 0806 15:55:47.218813 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:47.218874 (+ 61us) service_pool.cc:227] Handling call
0806 15:55:48.270610 (+1051736us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:47.322564 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:47.322681 (+ 117us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:47.322685 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:47.322686 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:47.322750 (+ 64us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:47.322758 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:47.322760 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:47.322814 (+ 54us) tablet.cc:699] Row locks acquired
0806 15:55:47.322815 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:47.322860 (+ 45us) write_op.cc:270] Start()
0806 15:55:48.124999 (+802139us) write_op.cc:276] Timestamp: P: 1786031747322801 usec, L: 0
0806 15:55:48.125002 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:55:48.125150 (+ 148us) log.cc:842] Serialized 354 byte log entry
0806 15:55:48.270174 (+145024us) op_driver.cc:444] REPLICATION: finished
0806 15:55:48.270245 (+ 71us) write_op.cc:301] APPLY: starting
0806 15:55:48.270261 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:48.270290 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:48.270303 (+ 13us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:48.270354 (+ 51us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:48.270384 (+ 30us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:48.270388 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:55:48.270464 (+ 76us) log.cc:842] Serialized 43 byte log entry
0806 15:55:48.270513 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:48.270525 (+ 12us) write_op.cc:454] Released schema lock
0806 15:55:48.270530 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":31,"num_ops":1,"prepare.queue_time_us":103358,"prepare.run_cpu_time_us":602,"prepare.run_wall_time_us":802677,"raft.queue_time_us":356,"raft.run_cpu_time_us":360,"raft.run_wall_time_us":361,"replication_time_us":145152}]]}
I20260806 15:55:48.271355 14815 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:48.680981 14930 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:48.681162 14930 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:48.681722 14930 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:48.682264 14460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 27 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:48.682267 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 27 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:48.682727 14529 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:48.682946 14930 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:48.718050 14930 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:48.718230 14930 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:48.718809 14930 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:48.719381 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:48.719411 14460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:48.719844 14529 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:48.720028 14930 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:48.830716 14815 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:48.830866 14815 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:48.831382 14815 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:48.831768 14599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:48.831909 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:48.832299 14392 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:48.832530 14815 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:49.189051 14815 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:49.189189 14815 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:49.189736 14815 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:49.190263 14598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 29 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:49.190254 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 29 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:49.190755 14390 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:49.191068 14815 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:49.280251 14930 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:49.280416 14930 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:49.281011 14930 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:49.281448 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 29 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:49.281734 14460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 29 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:49.282194 14529 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:49.311427 14930 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:49.741096 14815 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:49.741242 14815 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:49.741731 14815 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:49.742039 14599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 30 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:49.742148 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 30 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:49.742565 14390 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:49.742827 14815 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:50.630275 14964 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:50.630451 14964 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:50.631045 14964 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:50.631451 14598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 31 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:50.631466 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 31 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:50.631946 14390 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:50.632159 14964 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:50.632583 14966 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=29, attempt_no=0}) took 1440 ms. Trace:
I20260806 15:55:50.632679 14966 rpcz_store.cc:276] 0806 15:55:49.192553 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:49.192615 (+ 62us) service_pool.cc:227] Handling call
0806 15:55:50.632547 (+1439932us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:49.264611 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:49.264722 (+ 111us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:49.264726 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:49.264728 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:49.264821 (+ 93us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:49.264831 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:49.264834 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:49.264889 (+ 55us) tablet.cc:699] Row locks acquired
0806 15:55:49.264891 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:55:49.264935 (+ 44us) write_op.cc:270] Start()
0806 15:55:50.236081 (+971146us) write_op.cc:276] Timestamp: P: 1786031749264890 usec, L: 0
0806 15:55:50.236085 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:50.236262 (+ 177us) log.cc:842] Serialized 354 byte log entry
0806 15:55:50.631444 (+395182us) op_driver.cc:444] REPLICATION: finished
0806 15:55:50.631651 (+ 207us) write_op.cc:301] APPLY: starting
0806 15:55:50.631667 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:50.631698 (+ 31us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:50.632184 (+ 486us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:50.632252 (+ 68us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:50.632282 (+ 30us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:50.632287 (+ 5us) write_op.cc:312] APPLY: finished
0806 15:55:50.632367 (+ 80us) log.cc:842] Serialized 43 byte log entry
0806 15:55:50.632445 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:50.632458 (+ 13us) write_op.cc:454] Released schema lock
0806 15:55:50.632463 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":150,"num_ops":1,"prepare.queue_time_us":71604,"prepare.run_cpu_time_us":691,"prepare.run_wall_time_us":971745,"raft.queue_time_us":112,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":395338,"thread_start_us":85,"threads_started":1}]]}
I20260806 15:55:51.072263 14964 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:51.072454 14964 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:51.073004 14964 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:51.073382 14598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 32 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:51.073392 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 32 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:51.073805 14390 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:51.074296 14966 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=30, attempt_no=0}) took 1760 ms. Trace:
I20260806 15:55:51.074374 14966 rpcz_store.cc:276] 0806 15:55:49.314213 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:49.314282 (+ 69us) service_pool.cc:227] Handling call
0806 15:55:51.074284 (+1760002us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:50.236384 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:50.236496 (+ 112us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:50.236502 (+ 6us) write_op.cc:435] Acquired schema lock
0806 15:55:50.236503 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:50.236581 (+ 78us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:50.236592 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:50.236597 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:50.236643 (+ 46us) tablet.cc:699] Row locks acquired
0806 15:55:50.236663 (+ 20us) write_op.cc:260] PREPARE: finished
0806 15:55:50.236706 (+ 43us) write_op.cc:270] Start()
0806 15:55:50.529123 (+292417us) write_op.cc:276] Timestamp: P: 1786031750236652 usec, L: 0
0806 15:55:50.529132 (+ 9us) op_driver.cc:331] REPLICATION: starting
0806 15:55:50.529322 (+ 190us) log.cc:842] Serialized 354 byte log entry
0806 15:55:51.073762 (+544440us) op_driver.cc:444] REPLICATION: finished
0806 15:55:51.073844 (+ 82us) write_op.cc:301] APPLY: starting
0806 15:55:51.073862 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:51.073893 (+ 31us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:51.073910 (+ 17us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:51.073980 (+ 70us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:51.074012 (+ 32us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:51.074017 (+ 5us) write_op.cc:312] APPLY: finished
0806 15:55:51.074103 (+ 86us) log.cc:842] Serialized 22 byte log entry
0806 15:55:51.074198 (+ 95us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:51.074212 (+ 14us) write_op.cc:454] Released schema lock
0806 15:55:51.074217 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":28,"num_ops":1,"prepare.queue_time_us":921679,"prepare.run_cpu_time_us":1383,"prepare.run_wall_time_us":293032,"replication_time_us":544101}]]}
I20260806 15:55:51.134887 14963 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:51.135062 14963 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:51.135687 14963 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:51.136129 14460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 31 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:51.136148 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 31 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:51.136626 14529 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:52.056816 14964 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:52.058537 14976 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=31, attempt_no=0}) took 1424 ms. Trace:
I20260806 15:55:52.058640 14976 rpcz_store.cc:276] 0806 15:55:50.634141 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:50.634179 (+ 38us) service_pool.cc:227] Handling call
0806 15:55:52.058523 (+1424344us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:50.634488 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:50.634560 (+ 72us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:50.634562 (+ 2us) write_op.cc:435] Acquired schema lock
0806 15:55:50.634563 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:50.634616 (+ 53us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:50.634621 (+ 5us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:50.634623 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:50.634648 (+ 25us) tablet.cc:699] Row locks acquired
0806 15:55:50.634649 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:50.634675 (+ 26us) write_op.cc:270] Start()
0806 15:55:50.705814 (+ 71139us) write_op.cc:276] Timestamp: P: 1786031750634587 usec, L: 0
0806 15:55:50.705818 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:50.706013 (+ 195us) log.cc:842] Serialized 354 byte log entry
0806 15:55:52.057887 (+1351874us) op_driver.cc:444] REPLICATION: finished
0806 15:55:52.058207 (+ 320us) write_op.cc:301] APPLY: starting
0806 15:55:52.058221 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:52.058246 (+ 25us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:52.058260 (+ 14us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:52.058313 (+ 53us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:52.058333 (+ 20us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:52.058336 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:52.058402 (+ 66us) log.cc:842] Serialized 43 byte log entry
0806 15:55:52.058446 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:52.058455 (+ 9us) write_op.cc:454] Released schema lock
0806 15:55:52.058459 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":279,"num_ops":1,"prepare.queue_time_us":43,"prepare.run_cpu_time_us":538,"prepare.run_wall_time_us":71605,"replication_time_us":1352049,"thread_start_us":87,"threads_started":1}]]}
I20260806 15:55:52.551841 14963 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:52.552198 14599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.189.195:60405 (request call id 5088) took 1415 ms. Trace:
I20260806 15:55:52.552347 14599 rpcz_store.cc:276] 0806 15:55:51.136239 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:51.136310 (+ 71us) service_pool.cc:227] Handling call
0806 15:55:51.136493 (+ 183us) raft_consensus.cc:1457] Updating replica for 3 ops
0806 15:55:51.136602 (+ 109us) raft_consensus.cc:1520] Early marking committed up to index 31
0806 15:55:51.136764 (+ 162us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0806 15:55:51.136876 (+ 112us) write_op.cc:270] Start()
0806 15:55:51.615040 (+478164us) write_op.cc:276] Timestamp: P: 1786031750236652 usec, L: 0
0806 15:55:51.615339 (+ 299us) write_op.cc:270] Start()
0806 15:55:51.724520 (+109181us) write_op.cc:276] Timestamp: P: 1786031750634587 usec, L: 0
0806 15:55:51.724787 (+ 267us) write_op.cc:270] Start()
0806 15:55:52.550967 (+826180us) write_op.cc:276] Timestamp: P: 1786031751076200 usec, L: 0
0806 15:55:52.551441 (+ 474us) log.cc:842] Serialized 1062 byte log entry
0806 15:55:52.551593 (+ 152us) raft_consensus.cc:1631] Marking committed up to 32
0806 15:55:52.551739 (+ 146us) raft_consensus.cc:1683] Filling consensus response to leader.
0806 15:55:52.551774 (+ 35us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0806 15:55:52.552106 (+ 332us) raft_consensus.cc:1671] finished
0806 15:55:52.552110 (+ 4us) raft_consensus.cc:1677] UpdateReplicas() finished
0806 15:55:52.552182 (+ 72us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:51.615262 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:51.615363 (+ 101us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:51.615367 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:51.615368 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:51.615483 (+ 115us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:51.615497 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:51.615500 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:51.615552 (+ 52us) tablet.cc:699] Row locks acquired
0806 15:55:51.615553 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:52.551628 (+936075us) op_driver.cc:444] REPLICATION: finished
0806 15:55:52.551882 (+ 254us) write_op.cc:301] APPLY: starting
0806 15:55:52.551900 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:52.551931 (+ 31us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:52.551935 (+ 4us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:52.551996 (+ 61us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:52.552034 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:52.552064 (+ 30us) write_op.cc:312] APPLY: finished
0806 15:55:52.552220 (+ 156us) log.cc:842] Serialized 22 byte log entry
0806 15:55:52.552307 (+ 87us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:52.552343 (+ 36us) write_op.cc:454] Released schema lock
0806 15:55:52.552350 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0806 15:55:52.552420 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:52.552422 (+ 2us) write_op.cc:454] Released schema lock
Related trace 'op':
0806 15:55:51.724743 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:51.724840 (+ 97us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:51.724844 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:51.724845 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:51.724911 (+ 66us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:51.724944 (+ 33us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:51.724947 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:51.724985 (+ 38us) tablet.cc:699] Row locks acquired
0806 15:55:51.724986 (+ 1us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0806 15:55:52.551388 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:52.551505 (+ 117us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:52.551509 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:52.551510 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:52.551581 (+ 71us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:52.551590 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:52.551592 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:52.552361 (+ 769us) tablet.cc:699] Row locks acquired
0806 15:55:52.552363 (+ 2us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":92,"threads_started":1,"wal-append.queue_time_us":165,"child_traces":[["op",{"apply.queue_time_us":165,"apply.run_cpu_time_us":571,"apply.run_wall_time_us":620,"num_ops":1,"partition_lock_wait_us":7,"prepare.queue_time_us":69,"prepare.run_cpu_time_us":383,"prepare.run_wall_time_us":384,"replication_time_us":1414737,"thread_start_us":58,"threads_started":1}],["op",{"num_ops":1,"partition_lock_wait_us":28,"prepare.queue_time_us":77,"prepare.run_cpu_time_us":325,"prepare.run_wall_time_us":325}],["op",{"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":247,"prepare.run_cpu_time_us":480,"prepare.run_wall_time_us":1072,"row_lock_wait_count":1,"row_lock_wait_us":662,"spinlock_wait_cycles":65408,"thread_start_us":97,"threads_started":1}]]}
I20260806 15:55:52.554708 14976 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=32, attempt_no=0}) took 1479 ms. Trace:
I20260806 15:55:52.554790 14976 rpcz_store.cc:276] 0806 15:55:51.075604 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:51.075691 (+ 87us) service_pool.cc:227] Handling call
0806 15:55:52.554689 (+1478998us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:51.076058 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:51.076137 (+ 79us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:51.076140 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:55:51.076141 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:51.076198 (+ 57us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:51.076203 (+ 5us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:51.076205 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:51.076232 (+ 27us) tablet.cc:699] Row locks acquired
0806 15:55:51.076233 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:51.076258 (+ 25us) write_op.cc:270] Start()
0806 15:55:51.107396 (+ 31138us) write_op.cc:276] Timestamp: P: 1786031751076200 usec, L: 0
0806 15:55:51.107399 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:55:51.107598 (+ 199us) log.cc:842] Serialized 354 byte log entry
0806 15:55:52.554166 (+1446568us) op_driver.cc:444] REPLICATION: finished
0806 15:55:52.554261 (+ 95us) write_op.cc:301] APPLY: starting
0806 15:55:52.554276 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:52.554298 (+ 22us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:52.554313 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:52.554394 (+ 81us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:52.554418 (+ 24us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:52.554422 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:55:52.554527 (+ 105us) log.cc:842] Serialized 43 byte log entry
0806 15:55:52.554584 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:52.554593 (+ 9us) write_op.cc:454] Released schema lock
0806 15:55:52.554598 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":38,"num_ops":1,"prepare.queue_time_us":55,"prepare.run_cpu_time_us":555,"prepare.run_wall_time_us":31622,"replication_time_us":1446741}]]}
I20260806 15:55:52.663873 14963 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:52.664063 14963 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:52.664641 14963 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:52.665143 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:52.665194 14460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:52.665650 14529 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:52.665854 14963 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:52.687534 14964 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:52.687670 14964 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:52.688213 14964 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:52.688591 14598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 34 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:52.688606 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 34 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:52.689225 14390 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:52.689415 14964 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:53.623310 14964 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:53.623580 14964 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:53.624632 14964 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:53.625483 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:53.625649 14598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:53.626415 14390 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:53.852079 14987 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:53.852228 14987 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:53.852830 14987 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:53.853266 14460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 36 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:53.853868 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 36 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:53.854272 14530 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:53.854403 14993 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=34, attempt_no=0}) took 1298 ms. Trace:
I20260806 15:55:53.854483 14993 rpcz_store.cc:276] 0806 15:55:52.556201 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:52.556246 (+ 45us) service_pool.cc:227] Handling call
0806 15:55:53.854352 (+1298106us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:52.556657 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:52.556735 (+ 78us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:52.556737 (+ 2us) write_op.cc:435] Acquired schema lock
0806 15:55:52.556738 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:52.556796 (+ 58us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:52.556801 (+ 5us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:52.556803 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:52.556830 (+ 27us) tablet.cc:699] Row locks acquired
0806 15:55:52.556831 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:52.556859 (+ 28us) write_op.cc:270] Start()
0806 15:55:53.307987 (+751128us) write_op.cc:276] Timestamp: P: 1786031752556830 usec, L: 0
0806 15:55:53.307990 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:55:53.308146 (+ 156us) log.cc:842] Serialized 354 byte log entry
0806 15:55:53.853309 (+545163us) op_driver.cc:444] REPLICATION: finished
0806 15:55:53.853677 (+ 368us) write_op.cc:301] APPLY: starting
0806 15:55:53.853694 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:53.853723 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:53.853735 (+ 12us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:53.853793 (+ 58us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:53.853834 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:53.853841 (+ 7us) write_op.cc:312] APPLY: finished
0806 15:55:53.853919 (+ 78us) log.cc:842] Serialized 22 byte log entry
0806 15:55:53.854264 (+ 345us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:53.854279 (+ 15us) write_op.cc:454] Released schema lock
0806 15:55:53.854284 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":186,"num_ops":1,"prepare.queue_time_us":47,"prepare.run_cpu_time_us":482,"prepare.run_wall_time_us":751548,"replication_time_us":545297,"thread_start_us":80,"threads_started":1}]]}
I20260806 15:55:54.428758 14964 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:54.430727 14999 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=35, attempt_no=0}) took 1763 ms. Trace:
I20260806 15:55:54.430826 14999 rpcz_store.cc:276] 0806 15:55:52.666767 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:52.666825 (+ 58us) service_pool.cc:227] Handling call
0806 15:55:54.430696 (+1763871us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:53.308245 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:53.308355 (+ 110us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:53.308360 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:55:53.308361 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:53.308456 (+ 95us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:53.308467 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:53.308472 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:53.308520 (+ 48us) tablet.cc:699] Row locks acquired
0806 15:55:53.308521 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:53.308558 (+ 37us) write_op.cc:270] Start()
0806 15:55:53.340705 (+ 32147us) write_op.cc:276] Timestamp: P: 1786031753308495 usec, L: 0
0806 15:55:53.340709 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:53.340915 (+ 206us) log.cc:842] Serialized 354 byte log entry
0806 15:55:54.429990 (+1089075us) op_driver.cc:444] REPLICATION: finished
0806 15:55:54.430258 (+ 268us) write_op.cc:301] APPLY: starting
0806 15:55:54.430272 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:54.430299 (+ 27us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:54.430314 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:54.430369 (+ 55us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:54.430390 (+ 21us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:54.430393 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:54.430535 (+ 142us) log.cc:842] Serialized 43 byte log entry
0806 15:55:54.430593 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:54.430605 (+ 12us) write_op.cc:454] Released schema lock
0806 15:55:54.430610 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":216,"num_ops":1,"prepare.queue_time_us":641077,"prepare.run_cpu_time_us":687,"prepare.run_wall_time_us":32752,"replication_time_us":1089259,"thread_start_us":104,"threads_started":1}]]}
I20260806 15:55:54.608724 14987 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:54.830967 14987 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:54.831132 14987 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:54.831715 14987 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:54.832203 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 38 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:54.832203 14460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 38 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:54.832952 14529 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:54.833115 14987 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:55.443091 14964 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:55.443240 14964 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:55.443778 14964 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:55.444206 14598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 38 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:55.444206 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 38 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:55.444700 14390 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:55.557099 15007 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:55.557257 15007 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:55.557760 15007 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:55.558197 14460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 39 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:55.558642 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 39 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:55.558878 15013 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=37, attempt_no=0}) took 1126 ms. Trace:
I20260806 15:55:55.559149 14530 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:55.559033 15013 rpcz_store.cc:276] 0806 15:55:54.432313 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:54.432364 (+ 51us) service_pool.cc:227] Handling call
0806 15:55:55.558861 (+1126497us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:54.606967 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:54.607078 (+ 111us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:54.607083 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:55:54.607084 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:54.607161 (+ 77us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:54.607171 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:54.607175 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:54.607216 (+ 41us) tablet.cc:699] Row locks acquired
0806 15:55:54.607217 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:54.607258 (+ 41us) write_op.cc:270] Start()
0806 15:55:55.399400 (+792142us) write_op.cc:276] Timestamp: P: 1786031754607217 usec, L: 0
0806 15:55:55.399404 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:55.399587 (+ 183us) log.cc:842] Serialized 354 byte log entry
0806 15:55:55.558206 (+158619us) op_driver.cc:444] REPLICATION: finished
0806 15:55:55.558487 (+ 281us) write_op.cc:301] APPLY: starting
0806 15:55:55.558503 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:55.558535 (+ 32us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:55.558546 (+ 11us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:55.558612 (+ 66us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:55.558647 (+ 35us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:55.558651 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:55:55.558717 (+ 66us) log.cc:842] Serialized 22 byte log entry
0806 15:55:55.558773 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:55.558785 (+ 12us) write_op.cc:454] Released schema lock
0806 15:55:55.558791 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":231,"mutex_wait_us":40,"num_ops":1,"prepare.queue_time_us":174200,"prepare.run_cpu_time_us":775,"prepare.run_wall_time_us":792855,"raft.queue_time_us":178,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":3,"replication_time_us":158779,"spinlock_wait_cycles":3456,"thread_start_us":229,"threads_started":2}]]}
I20260806 15:55:55.559338 15007 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:55.878891 14964 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:57.191962 14964 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:57.192133 14964 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:57.192683 14964 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:57.193089 14598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 40 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:57.193338 15015 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:57.193435 15015 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:57.193868 15015 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:57.194278 14737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 40 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:57.194340 14459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 40 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:57.194536 14736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 40 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:57.195003 14530 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:57.195097 14392 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:57.195225 15015 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:57.196174 15022 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=38, attempt_no=0}) took 2362 ms. Trace:
I20260806 15:55:57.196290 15022 rpcz_store.cc:276] 0806 15:55:54.833823 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:54.833884 (+ 61us) service_pool.cc:227] Handling call
0806 15:55:57.196144 (+2362260us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:55.399849 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:55.399996 (+ 147us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:55.400000 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:55.400002 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:55.400074 (+ 72us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:55.400081 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:55.400083 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:55.400140 (+ 57us) tablet.cc:699] Row locks acquired
0806 15:55:55.400142 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:55:55.400181 (+ 39us) write_op.cc:270] Start()
0806 15:55:56.299332 (+899151us) write_op.cc:276] Timestamp: P: 1786031755400123 usec, L: 0
0806 15:55:56.299334 (+ 2us) op_driver.cc:331] REPLICATION: starting
0806 15:55:56.299560 (+ 226us) log.cc:842] Serialized 354 byte log entry
0806 15:55:57.193443 (+893883us) op_driver.cc:444] REPLICATION: finished
0806 15:55:57.195457 (+ 2014us) write_op.cc:301] APPLY: starting
0806 15:55:57.195471 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:57.195811 (+ 340us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:57.195828 (+ 17us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:57.195880 (+ 52us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:57.195906 (+ 26us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:57.195910 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:55:57.195981 (+ 71us) log.cc:842] Serialized 43 byte log entry
0806 15:55:57.196049 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:57.196059 (+ 10us) write_op.cc:454] Released schema lock
0806 15:55:57.196065 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1959,"num_ops":1,"prepare.queue_time_us":565571,"prepare.run_cpu_time_us":729,"prepare.run_wall_time_us":899796,"raft.queue_time_us":21,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":154,"replication_time_us":894086,"spinlock_wait_cycles":116096,"thread_start_us":63,"threads_started":1}]]}
I20260806 15:55:57.300428 15015 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:57.300576 15015 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:57.301194 15015 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:57.301702 14736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:57.301707 14459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:57.302160 15022 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=39, attempt_no=0}) took 1741 ms. Trace:
I20260806 15:55:57.302234 15022 rpcz_store.cc:276] 0806 15:55:55.560471 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:55.560534 (+ 63us) service_pool.cc:227] Handling call
0806 15:55:57.302150 (+1741616us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:56.299679 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:56.299781 (+ 102us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:56.299785 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:56.299787 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:56.299867 (+ 80us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:56.299875 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:56.299877 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:56.299922 (+ 45us) tablet.cc:699] Row locks acquired
0806 15:55:56.299923 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:56.299974 (+ 51us) write_op.cc:270] Start()
0806 15:55:56.360125 (+ 60151us) write_op.cc:276] Timestamp: P: 1786031756299924 usec, L: 0
0806 15:55:56.360129 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:56.360342 (+ 213us) log.cc:842] Serialized 354 byte log entry
0806 15:55:57.301620 (+941278us) op_driver.cc:444] REPLICATION: finished
0806 15:55:57.301693 (+ 73us) write_op.cc:301] APPLY: starting
0806 15:55:57.301708 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:57.301738 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:57.301751 (+ 13us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:57.301810 (+ 59us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:57.301851 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:57.301854 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:55:57.301956 (+ 102us) log.cc:842] Serialized 43 byte log entry
0806 15:55:57.302008 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:57.302021 (+ 13us) write_op.cc:454] Released schema lock
0806 15:55:57.302029 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":36,"num_ops":1,"prepare.queue_time_us":738824,"prepare.run_cpu_time_us":668,"prepare.run_wall_time_us":60737,"replication_time_us":941468}]]}
I20260806 15:55:57.302579 14530 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:57.302750 15015 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:58.035573 14964 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:58.067003 15015 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:58.067166 15015 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:58.067752 15015 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:58.068148 14736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 42 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:58.068193 14459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 42 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:58.068594 14530 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:58.068774 15015 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:58.376155 15015 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:58.376291 15015 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:58.376869 15015 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:58.377292 14459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:58.377713 14736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:58.378111 14530 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:58.378321 15031 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=41, attempt_no=0}) took 1074 ms. Trace:
I20260806 15:55:58.378327 15015 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:55:58.378397 15031 rpcz_store.cc:276] 0806 15:55:57.303762 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:57.303798 (+ 36us) service_pool.cc:227] Handling call
0806 15:55:58.378282 (+1074484us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:57.347122 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:57.347246 (+ 124us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:57.347253 (+ 7us) write_op.cc:435] Acquired schema lock
0806 15:55:57.347256 (+ 3us) tablet.cc:660] Decoding operations
0806 15:55:57.347335 (+ 79us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:57.347346 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:57.347350 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:57.347394 (+ 44us) tablet.cc:699] Row locks acquired
0806 15:55:57.347395 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:57.347436 (+ 41us) write_op.cc:270] Start()
0806 15:55:57.489606 (+142170us) write_op.cc:276] Timestamp: P: 1786031757347388 usec, L: 0
0806 15:55:57.489610 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:55:57.489819 (+ 209us) log.cc:842] Serialized 354 byte log entry
0806 15:55:58.377159 (+887340us) op_driver.cc:444] REPLICATION: finished
0806 15:55:58.377252 (+ 93us) write_op.cc:301] APPLY: starting
0806 15:55:58.377271 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:58.377301 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:58.377314 (+ 13us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:58.377381 (+ 67us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:58.377430 (+ 49us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:58.377436 (+ 6us) write_op.cc:312] APPLY: finished
0806 15:55:58.378073 (+ 637us) log.cc:842] Serialized 43 byte log entry
0806 15:55:58.378172 (+ 99us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:58.378180 (+ 8us) write_op.cc:454] Released schema lock
0806 15:55:58.378201 (+ 21us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":35,"num_ops":1,"prepare.queue_time_us":42902,"prepare.run_cpu_time_us":728,"prepare.run_wall_time_us":142804,"replication_time_us":887526}]]}
I20260806 15:55:59.359438 14460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.189.195:51177 (request call id 3254) took 1322 ms. Trace:
I20260806 15:55:59.359544 14460 rpcz_store.cc:276] 0806 15:55:58.037041 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:58.037101 (+ 60us) service_pool.cc:227] Handling call
0806 15:55:58.037298 (+ 197us) raft_consensus.cc:1457] Updating replica for 2 ops
0806 15:55:58.037375 (+ 77us) raft_consensus.cc:1520] Early marking committed up to index 41
0806 15:55:58.037502 (+ 127us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0806 15:55:58.037596 (+ 94us) write_op.cc:270] Start()
0806 15:55:59.019754 (+982158us) write_op.cc:276] Timestamp: P: 1786031757198625 usec, L: 0
0806 15:55:59.020102 (+ 348us) write_op.cc:270] Start()
0806 15:55:59.358267 (+338165us) write_op.cc:276] Timestamp: P: 1786031757347388 usec, L: 0
0806 15:55:59.358670 (+ 403us) log.cc:842] Serialized 708 byte log entry
0806 15:55:59.358817 (+ 147us) raft_consensus.cc:1631] Marking committed up to 41
0806 15:55:59.358823 (+ 6us) raft_consensus.cc:1683] Filling consensus response to leader.
0806 15:55:59.358851 (+ 28us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0806 15:55:59.359360 (+ 509us) raft_consensus.cc:1671] finished
0806 15:55:59.359362 (+ 2us) raft_consensus.cc:1677] UpdateReplicas() finished
0806 15:55:59.359414 (+ 52us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:59.020096 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:59.020199 (+ 103us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:59.020203 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:59.020204 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:59.020272 (+ 68us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:59.020282 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:59.020284 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:59.020327 (+ 43us) tablet.cc:699] Row locks acquired
0806 15:55:59.020328 (+ 1us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0806 15:55:59.358527 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:59.358644 (+ 117us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:59.358649 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:55:59.358651 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:59.358729 (+ 78us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:59.358745 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:59.358748 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:59.358793 (+ 45us) tablet.cc:699] Row locks acquired
0806 15:55:59.358794 (+ 1us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":93,"threads_started":1,"wal-append.queue_time_us":290,"child_traces":[["op",{"num_ops":1,"partition_lock_wait_us":6,"prepare.queue_time_us":212,"prepare.run_cpu_time_us":315,"prepare.run_wall_time_us":315,"thread_start_us":86,"threads_started":1}],["op",{"num_ops":1,"partition_lock_wait_us":6,"prepare.queue_time_us":81,"prepare.run_cpu_time_us":372,"prepare.run_wall_time_us":373}]]}
I20260806 15:55:59.362129 14964 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:59.362259 14964 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:59.362777 14964 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:59.363452 14736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:59.363806 14598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:55:59.364467 14390 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:55:59.452184 15015 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:55:59.452338 15015 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:55:59.452937 15015 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:55:59.453361 14459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 44 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:55:59.453892 14736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 44 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:55:59.454026 15043 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=42, attempt_no=0}) took 1383 ms. Trace:
I20260806 15:55:59.454293 14530 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:55:59.454116 15043 rpcz_store.cc:276] 0806 15:55:58.070432 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:58.070499 (+ 67us) service_pool.cc:227] Handling call
0806 15:55:59.454014 (+1383515us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:58.071039 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:58.071116 (+ 77us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:58.071119 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:55:58.071120 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:58.071174 (+ 54us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:58.071179 (+ 5us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:58.071181 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:58.071207 (+ 26us) tablet.cc:699] Row locks acquired
0806 15:55:58.071208 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:58.071237 (+ 29us) write_op.cc:270] Start()
0806 15:55:58.538375 (+467138us) write_op.cc:276] Timestamp: P: 1786031758071208 usec, L: 0
0806 15:55:58.538378 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:55:58.538588 (+ 210us) log.cc:842] Serialized 354 byte log entry
0806 15:55:59.453351 (+914763us) op_driver.cc:444] REPLICATION: finished
0806 15:55:59.453591 (+ 240us) write_op.cc:301] APPLY: starting
0806 15:55:59.453607 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:55:59.453635 (+ 28us) tablet.cc:1368] finished BulkCheckPresence
0806 15:55:59.453648 (+ 13us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:55:59.453712 (+ 64us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:55:59.453747 (+ 35us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:55:59.453757 (+ 10us) write_op.cc:312] APPLY: finished
0806 15:55:59.453852 (+ 95us) log.cc:842] Serialized 43 byte log entry
0806 15:55:59.453906 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:55:59.453919 (+ 13us) write_op.cc:454] Released schema lock
0806 15:55:59.453925 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":182,"num_ops":1,"prepare.queue_time_us":185,"prepare.run_cpu_time_us":618,"prepare.run_wall_time_us":467672,"raft.queue_time_us":46,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":7,"replication_time_us":914949,"spinlock_wait_cycles":54656,"thread_start_us":187,"threads_started":2}]]}
I20260806 15:56:00.067555 15015 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:56:00.069402 15049 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=43, attempt_no=0}) took 1689 ms. Trace:
I20260806 15:56:00.069527 15049 rpcz_store.cc:276] 0806 15:55:58.379813 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:58.379868 (+ 55us) service_pool.cc:227] Handling call
0806 15:56:00.069377 (+1689509us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:58.538742 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:58.538853 (+ 111us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:58.538857 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:58.538858 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:58.538956 (+ 98us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:58.538966 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:58.538969 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:58.539015 (+ 46us) tablet.cc:699] Row locks acquired
0806 15:55:58.539017 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:55:58.539060 (+ 43us) write_op.cc:270] Start()
0806 15:55:58.606232 (+ 67172us) write_op.cc:276] Timestamp: P: 1786031758539036 usec, L: 0
0806 15:55:58.606237 (+ 5us) op_driver.cc:331] REPLICATION: starting
0806 15:55:58.606468 (+ 231us) log.cc:842] Serialized 354 byte log entry
0806 15:56:00.068668 (+1462200us) op_driver.cc:444] REPLICATION: finished
0806 15:56:00.068914 (+ 246us) write_op.cc:301] APPLY: starting
0806 15:56:00.068930 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:56:00.068962 (+ 32us) tablet.cc:1368] finished BulkCheckPresence
0806 15:56:00.068977 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:56:00.069042 (+ 65us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:56:00.069074 (+ 32us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:56:00.069078 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:56:00.069212 (+ 134us) log.cc:842] Serialized 43 byte log entry
0806 15:56:00.069269 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:56:00.069281 (+ 12us) write_op.cc:454] Released schema lock
0806 15:56:00.069286 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":183,"num_ops":1,"prepare.queue_time_us":158552,"prepare.run_cpu_time_us":713,"prepare.run_wall_time_us":67790,"replication_time_us":1462391,"thread_start_us":76,"threads_started":1}]]}
I20260806 15:56:00.603549 14964 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:56:00.604009 14460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.189.195:51177 (request call id 3255) took 1239 ms. Trace:
I20260806 15:56:00.604104 14460 rpcz_store.cc:276] 0806 15:55:59.364424 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:59.364480 (+ 56us) service_pool.cc:227] Handling call
0806 15:55:59.364656 (+ 176us) raft_consensus.cc:1457] Updating replica for 2 ops
0806 15:55:59.364753 (+ 97us) raft_consensus.cc:1520] Early marking committed up to index 43
0806 15:55:59.365062 (+ 309us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0806 15:55:59.365182 (+ 120us) write_op.cc:270] Start()
0806 15:55:59.674365 (+309183us) write_op.cc:276] Timestamp: P: 1786031758071208 usec, L: 0
0806 15:55:59.674630 (+ 265us) write_op.cc:270] Start()
0806 15:56:00.602806 (+928176us) write_op.cc:276] Timestamp: P: 1786031758539036 usec, L: 0
0806 15:56:00.603276 (+ 470us) log.cc:842] Serialized 708 byte log entry
0806 15:56:00.603448 (+ 172us) raft_consensus.cc:1631] Marking committed up to 43
0806 15:56:00.603456 (+ 8us) raft_consensus.cc:1683] Filling consensus response to leader.
0806 15:56:00.603490 (+ 34us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0806 15:56:00.603945 (+ 455us) raft_consensus.cc:1671] finished
0806 15:56:00.603947 (+ 2us) raft_consensus.cc:1677] UpdateReplicas() finished
0806 15:56:00.603994 (+ 47us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:59.674607 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:59.674709 (+ 102us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:59.674713 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:55:59.674715 (+ 2us) tablet.cc:660] Decoding operations
0806 15:55:59.674784 (+ 69us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:59.674794 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:59.674829 (+ 35us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:59.674874 (+ 45us) tablet.cc:699] Row locks acquired
0806 15:55:59.674875 (+ 1us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0806 15:56:00.603142 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:56:00.603263 (+ 121us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:56:00.603268 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:56:00.603269 (+ 1us) tablet.cc:660] Decoding operations
0806 15:56:00.603354 (+ 85us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:56:00.603370 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0806 15:56:00.603376 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:56:00.603423 (+ 47us) tablet.cc:699] Row locks acquired
0806 15:56:00.603424 (+ 1us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":85,"threads_started":1,"wal-append.queue_time_us":183,"child_traces":[["op",{"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":80,"prepare.run_cpu_time_us":377,"prepare.run_wall_time_us":378}],["op",{"num_ops":1,"partition_lock_wait_us":6,"prepare.queue_time_us":213,"prepare.run_cpu_time_us":373,"prepare.run_wall_time_us":373,"thread_start_us":112,"threads_started":1}]]}
I20260806 15:56:00.985543 15015 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:56:00.985702 15015 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:56:00.986299 15015 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:56:00.986738 14459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 46 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:56:00.986737 14736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 46 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:56:00.987313 14529 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:56:00.987494 15015 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:56:00.987823 15057 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=44, attempt_no=0}) took 1532 ms. Trace:
I20260806 15:56:00.987927 15057 rpcz_store.cc:276] 0806 15:55:59.455558 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:55:59.455634 (+ 76us) service_pool.cc:227] Handling call
0806 15:56:00.987807 (+1532173us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:55:59.456095 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:55:59.456164 (+ 69us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:55:59.456167 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:55:59.456168 (+ 1us) tablet.cc:660] Decoding operations
0806 15:55:59.456219 (+ 51us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:55:59.456224 (+ 5us) write_op.cc:641] Partition lock acquired for write op
0806 15:55:59.456226 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:55:59.456251 (+ 25us) tablet.cc:699] Row locks acquired
0806 15:55:59.456252 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:55:59.456276 (+ 24us) write_op.cc:270] Start()
0806 15:56:00.199431 (+743155us) write_op.cc:276] Timestamp: P: 1786031759456220 usec, L: 0
0806 15:56:00.199435 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:56:00.199629 (+ 194us) log.cc:842] Serialized 354 byte log entry
0806 15:56:00.986785 (+787156us) op_driver.cc:444] REPLICATION: finished
0806 15:56:00.987144 (+ 359us) write_op.cc:301] APPLY: starting
0806 15:56:00.987163 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0806 15:56:00.987211 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0806 15:56:00.987228 (+ 17us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:56:00.987302 (+ 74us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:56:00.987338 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:56:00.987342 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:56:00.987460 (+ 118us) log.cc:842] Serialized 43 byte log entry
0806 15:56:00.987695 (+ 235us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:56:00.987709 (+ 14us) write_op.cc:454] Released schema lock
0806 15:56:00.987715 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":300,"num_ops":1,"prepare.queue_time_us":152,"prepare.run_cpu_time_us":525,"prepare.run_wall_time_us":743588,"replication_time_us":787327,"spinlock_wait_cycles":1408,"thread_start_us":156,"threads_started":2}]]}
I20260806 15:56:01.423748 14964 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:56:01.423908 14964 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:56:01.424468 14964 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:56:01.424877 14598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 46 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:56:01.424916 14736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 46 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:56:01.425364 14390 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:56:01.905766 15015 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:56:01.905916 15015 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:56:01.906538 15015 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:56:01.906992 14459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:56:01.906991 14736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:56:01.907516 14529 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:56:01.908114 15064 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=45, attempt_no=0}) took 1837 ms. Trace:
I20260806 15:56:01.908208 15064 rpcz_store.cc:276] 0806 15:56:00.071102 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:56:00.071166 (+ 64us) service_pool.cc:227] Handling call
0806 15:56:01.908090 (+1836924us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:56:00.199718 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:56:00.199826 (+ 108us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:56:00.199831 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:56:00.199832 (+ 1us) tablet.cc:660] Decoding operations
0806 15:56:00.199933 (+ 101us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:56:00.199942 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:56:00.199946 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:56:00.199990 (+ 44us) tablet.cc:699] Row locks acquired
0806 15:56:00.199992 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:56:00.200025 (+ 33us) write_op.cc:270] Start()
0806 15:56:00.994155 (+794130us) write_op.cc:276] Timestamp: P: 1786031760199998 usec, L: 0
0806 15:56:00.994158 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:56:00.994329 (+ 171us) log.cc:842] Serialized 354 byte log entry
0806 15:56:01.906787 (+912458us) op_driver.cc:444] REPLICATION: finished
0806 15:56:01.907715 (+ 928us) write_op.cc:301] APPLY: starting
0806 15:56:01.907736 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0806 15:56:01.907760 (+ 24us) tablet.cc:1368] finished BulkCheckPresence
0806 15:56:01.907770 (+ 10us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:56:01.907815 (+ 45us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:56:01.907835 (+ 20us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:56:01.907838 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:56:01.907915 (+ 77us) log.cc:842] Serialized 43 byte log entry
0806 15:56:01.907990 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:56:01.908002 (+ 12us) write_op.cc:454] Released schema lock
0806 15:56:01.908008 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":879,"num_ops":1,"prepare.queue_time_us":128142,"prepare.run_cpu_time_us":603,"prepare.run_wall_time_us":794675,"replication_time_us":912607,"thread_start_us":222,"threads_started":1}]]}
I20260806 15:56:02.104521 14964 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:56:02.434525 15015 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:56:02.436388 15070 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=46, attempt_no=0}) took 1447 ms. Trace:
I20260806 15:56:02.436488 15070 rpcz_store.cc:276] 0806 15:56:00.989420 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:56:00.989468 (+ 48us) service_pool.cc:227] Handling call
0806 15:56:02.436367 (+1446899us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:56:00.994426 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:56:00.994537 (+ 111us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:56:00.994540 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:56:00.994542 (+ 2us) tablet.cc:660] Decoding operations
0806 15:56:00.994643 (+ 101us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:56:00.994652 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0806 15:56:00.994656 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:56:00.994694 (+ 38us) tablet.cc:699] Row locks acquired
0806 15:56:00.994696 (+ 2us) write_op.cc:260] PREPARE: finished
0806 15:56:00.994736 (+ 40us) write_op.cc:270] Start()
0806 15:56:01.499947 (+505211us) write_op.cc:276] Timestamp: P: 1786031760994678 usec, L: 0
0806 15:56:01.499951 (+ 4us) op_driver.cc:331] REPLICATION: starting
0806 15:56:01.500150 (+ 199us) log.cc:842] Serialized 354 byte log entry
0806 15:56:02.435675 (+935525us) op_driver.cc:444] REPLICATION: finished
0806 15:56:02.435917 (+ 242us) write_op.cc:301] APPLY: starting
0806 15:56:02.435935 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:56:02.436001 (+ 66us) tablet.cc:1368] finished BulkCheckPresence
0806 15:56:02.436024 (+ 23us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:56:02.436095 (+ 71us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:56:02.436117 (+ 22us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:56:02.436121 (+ 4us) write_op.cc:312] APPLY: finished
0806 15:56:02.436212 (+ 91us) log.cc:842] Serialized 43 byte log entry
0806 15:56:02.436271 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:56:02.436283 (+ 12us) write_op.cc:454] Released schema lock
0806 15:56:02.436287 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":183,"num_ops":1,"prepare.queue_time_us":4549,"prepare.run_cpu_time_us":694,"prepare.run_wall_time_us":505786,"replication_time_us":935701,"thread_start_us":80,"threads_started":1}]]}
I20260806 15:56:03.038499 15015 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:56:03.038668 15015 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:56:03.039230 15015 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:56:03.039661 14736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 49 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:56:03.039706 14459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 49 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:56:03.040208 14529 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:56:03.041090 15076 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=47, attempt_no=0}) took 1131 ms. Trace:
I20260806 15:56:03.041169 15076 rpcz_store.cc:276] 0806 15:56:01.909471 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:56:01.909510 (+ 39us) service_pool.cc:227] Handling call
0806 15:56:03.041076 (+1131566us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:56:01.909846 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:56:01.909918 (+ 72us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:56:01.909921 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:56:01.909922 (+ 1us) tablet.cc:660] Decoding operations
0806 15:56:01.910010 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:56:01.910015 (+ 5us) write_op.cc:641] Partition lock acquired for write op
0806 15:56:01.910017 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:56:01.910045 (+ 28us) tablet.cc:699] Row locks acquired
0806 15:56:01.910046 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:56:01.910072 (+ 26us) write_op.cc:270] Start()
0806 15:56:02.177256 (+267184us) write_op.cc:276] Timestamp: P: 1786031761910024 usec, L: 0
0806 15:56:02.177259 (+ 3us) op_driver.cc:331] REPLICATION: starting
0806 15:56:02.177487 (+ 228us) log.cc:842] Serialized 354 byte log entry
0806 15:56:03.039972 (+862485us) op_driver.cc:444] REPLICATION: finished
0806 15:56:03.040721 (+ 749us) write_op.cc:301] APPLY: starting
0806 15:56:03.040737 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:56:03.040767 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0806 15:56:03.040780 (+ 13us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:56:03.040824 (+ 44us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:56:03.040843 (+ 19us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:56:03.040845 (+ 2us) write_op.cc:312] APPLY: finished
0806 15:56:03.040901 (+ 56us) log.cc:842] Serialized 43 byte log entry
0806 15:56:03.040980 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:56:03.040990 (+ 10us) write_op.cc:454] Released schema lock
0806 15:56:03.040995 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":696,"num_ops":1,"prepare.queue_time_us":38,"prepare.run_cpu_time_us":662,"prepare.run_wall_time_us":267699,"replication_time_us":862691,"thread_start_us":635,"threads_started":1}]]}
I20260806 15:56:03.091163 14964 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:56:03.091348 14964 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:56:03.091871 14964 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6de0c8fde1149d09d735226abe0a9e1 (127.10.189.194:37079), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:56:03.092386 14736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 48 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:56:03.092401 14598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "1f69271e143c4b0baa12386105c8064c" candidate_term: 2 candidate_status { last_received { term: 1 index: 48 } } ignore_live_leader: false dest_uuid: "f6de0c8fde1149d09d735226abe0a9e1" is_pre_election: true
I20260806 15:56:03.092978 14390 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f69271e143c4b0baa12386105c8064c; no voters: 90e80c401c894ab2bc7a4d60ce338cbb, f6de0c8fde1149d09d735226abe0a9e1
I20260806 15:56:03.855257 15015 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:56:03.857194 15082 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:57518 (ReqId={client: 403ea001bce04bc7b5391a68b2a6e4b2, seq_no=48, attempt_no=0}) took 1418 ms. Trace:
I20260806 15:56:03.857293 15082 rpcz_store.cc:276] 0806 15:56:02.438272 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:56:02.438326 (+ 54us) service_pool.cc:227] Handling call
0806 15:56:03.857124 (+1418798us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:56:02.438755 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c8678de65e594defb0360c1ec12cbdbb
0806 15:56:02.438829 (+ 74us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:56:02.438832 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:56:02.438833 (+ 1us) tablet.cc:660] Decoding operations
0806 15:56:02.438889 (+ 56us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:56:02.438896 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0806 15:56:02.438897 (+ 1us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:56:02.438925 (+ 28us) tablet.cc:699] Row locks acquired
0806 15:56:02.438926 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:56:02.438962 (+ 36us) write_op.cc:270] Start()
0806 15:56:03.017334 (+578372us) write_op.cc:276] Timestamp: P: 1786031762438933 usec, L: 0
0806 15:56:03.017346 (+ 12us) op_driver.cc:331] REPLICATION: starting
0806 15:56:03.017569 (+ 223us) log.cc:842] Serialized 354 byte log entry
0806 15:56:03.856375 (+838806us) op_driver.cc:444] REPLICATION: finished
0806 15:56:03.856604 (+ 229us) write_op.cc:301] APPLY: starting
0806 15:56:03.856635 (+ 31us) tablet.cc:1365] starting BulkCheckPresence
0806 15:56:03.856664 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0806 15:56:03.856678 (+ 14us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:56:03.856742 (+ 64us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:56:03.856776 (+ 34us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:56:03.856779 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:56:03.856910 (+ 131us) log.cc:842] Serialized 43 byte log entry
0806 15:56:03.856987 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:56:03.857028 (+ 41us) write_op.cc:454] Released schema lock
0806 15:56:03.857033 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":186,"num_ops":1,"prepare.queue_time_us":59,"prepare.run_cpu_time_us":739,"prepare.run_wall_time_us":578915,"replication_time_us":839007,"thread_start_us":77,"threads_started":1}]]}
I20260806 15:56:03.922868 14717 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260806 15:56:03.923094 14577 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260806 15:56:03.933626 15015 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:56:03.933760 15015 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:56:03.934363 15015 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:56:03.934690 14459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 50 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:56:03.934793 14736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 50 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:56:03.935189 14530 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:56:03.935396 15015 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:56:04.089437 14964 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P 1f69271e143c4b0baa12386105c8064c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:56:04.092272 14439 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260806 15:56:04.100392 15015 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:56:04.100529 15015 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:56:04.100962 15015 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:56:04.101287 14459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 50 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:56:04.101868 14736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 50 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:56:04.102332 14530 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:56:04.102703 15015 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
460782632f6c41588199be78d5d78564 | 127.10.189.254:39723 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.189.212:39793 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
1f69271e143c4b0baa12386105c8064c | 127.10.189.193:38953 | HEALTHY | <none> | 0 | 0
90e80c401c894ab2bc7a4d60ce338cbb | 127.10.189.195:42369 | HEALTHY | <none> | 1 | 0
f6de0c8fde1149d09d735226abe0a9e1 | 127.10.189.194:37079 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
--------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
inject_latency_ms_before_starting_op | 1000 | hidden,advanced | all 3 server(s) checked
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.10.189.193 | experimental | 127.10.189.193:38953
local_ip_for_outbound_sockets | 127.10.189.194 | experimental | 127.10.189.194:37079
local_ip_for_outbound_sockets | 127.10.189.195 | experimental | 127.10.189.195:42369
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.10.189.193:38953
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.10.189.194:37079
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.10.189.195:42369
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.189.212:39793 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260806 15:56:04.116263 10999 log_verifier.cc:126] Checking tablet c8678de65e594defb0360c1ec12cbdbb
I20260806 15:56:04.122931 15015 raft_consensus.cc:482] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90e80c401c894ab2bc7a4d60ce338cbb)
I20260806 15:56:04.123081 15015 raft_consensus.cc:504] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f69271e143c4b0baa12386105c8064c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 38953 } } peers { permanent_uuid: "f6de0c8fde1149d09d735226abe0a9e1" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37079 } } peers { permanent_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42369 } }
I20260806 15:56:04.123512 15015 leader_election.cc:288] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953), 90e80c401c894ab2bc7a4d60ce338cbb (127.10.189.195:42369)
I20260806 15:56:04.123953 14736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 50 } } ignore_live_leader: false dest_uuid: "90e80c401c894ab2bc7a4d60ce338cbb" is_pre_election: true
I20260806 15:56:04.124032 14459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8678de65e594defb0360c1ec12cbdbb" candidate_uuid: "f6de0c8fde1149d09d735226abe0a9e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 50 } } ignore_live_leader: false dest_uuid: "1f69271e143c4b0baa12386105c8064c" is_pre_election: true
I20260806 15:56:04.124413 14529 leader_election.cc:302] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6de0c8fde1149d09d735226abe0a9e1; no voters: 1f69271e143c4b0baa12386105c8064c, 90e80c401c894ab2bc7a4d60ce338cbb
I20260806 15:56:04.124583 15015 raft_consensus.cc:2726] T c8678de65e594defb0360c1ec12cbdbb P f6de0c8fde1149d09d735226abe0a9e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:56:04.159576 10999 log_verifier.cc:177] Verified matching terms for 50 ops in tablet c8678de65e594defb0360c1ec12cbdbb
I20260806 15:56:04.183794 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 14372
W20260806 15:56:04.194046 14665 connection.cc:535] client connection to 127.10.189.193:38953 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 15:56:04.194201 14665 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 1 similar messages]
I20260806 15:56:04.194972 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 14511
W20260806 15:56:04.200101 14665 consensus_peers.cc:487] T c8678de65e594defb0360c1ec12cbdbb P 90e80c401c894ab2bc7a4d60ce338cbb -> Peer 1f69271e143c4b0baa12386105c8064c (127.10.189.193:38953): Couldn't send request to peer 1f69271e143c4b0baa12386105c8064c. Status: Network error: Client connection negotiation failed: client connection to 127.10.189.193:38953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260806 15:56:04.203583 14664 connection.cc:535] client connection to 127.10.189.194:37079 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 15:56:04.203923 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 14649
I20260806 15:56:04.211524 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 14280
2026-08-06T15:56:04Z chronyd exiting
[ OK ] RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys (32500 ms)
[ RUN ] RaftConsensusElectionITest.AutomaticLeaderElection
I20260806 15:56:04.236554 10999 test_util.cc:268] Using random seed: -321033980
I20260806 15:56:04.237373 10999 ts_itest-base.cc:112] Starting cluster with:
I20260806 15:56:04.237429 10999 ts_itest-base.cc:113] --------------
I20260806 15:56:04.237450 10999 ts_itest-base.cc:114] 5 tablet servers
I20260806 15:56:04.237478 10999 ts_itest-base.cc:115] 5 replicas per TS
I20260806 15:56:04.237502 10999 ts_itest-base.cc:116] --------------
2026-08-06T15:56:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:56:04Z Disabled control of system clock
I20260806 15:56:04.246976 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:44073
--webserver_interface=127.10.189.254
--webserver_port=0
--builtin_ntp_servers=127.10.189.212:41733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.189.254:44073 with env {}
W20260806 15:56:04.356734 15131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:04.357046 15131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:04.357117 15131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:04.361236 15131 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:56:04.361328 15131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:04.361364 15131 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:56:04.361400 15131 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:56:04.366219 15131 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:41733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.189.254:44073
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:44073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.10.189.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.15131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:04.367331 15131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:04.368775 15131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:04.377560 15140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:04.377540 15138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:04.377610 15131 server_base.cc:1034] running on GCE node
W20260806 15:56:04.377533 15136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:04.378456 15131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:04.379534 15131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:04.380749 15131 hybrid_clock.cc:648] HybridClock initialized: now 1786031764380723 us; error 42 us; skew 500 ppm
I20260806 15:56:04.382722 15131 webserver.cc:460] Webserver started at http://127.10.189.254:35945/ using document root <none> and password file <none>
I20260806 15:56:04.383298 15131 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:04.383392 15131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:04.383633 15131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:04.385516 15131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "4ba81bb4a42c4575a61f38028abaab1e"
format_stamp: "Formatted at 2026-08-06 15:56:04 on dist-test-slave-mn4r"
I20260806 15:56:04.386135 15131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "4ba81bb4a42c4575a61f38028abaab1e"
format_stamp: "Formatted at 2026-08-06 15:56:04 on dist-test-slave-mn4r"
I20260806 15:56:04.389685 15131 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 15:56:04.392113 15146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:04.393321 15131 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 15:56:04.393473 15131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
uuid: "4ba81bb4a42c4575a61f38028abaab1e"
format_stamp: "Formatted at 2026-08-06 15:56:04 on dist-test-slave-mn4r"
I20260806 15:56:04.393584 15131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:04.405094 15131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:04.405727 15131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:04.405915 15131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:04.413076 15131 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.254:44073
I20260806 15:56:04.413096 15202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.254:44073 every 8 connection(s)
I20260806 15:56:04.414042 15131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260806 15:56:04.417258 15203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:04.422300 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 15131
I20260806 15:56:04.422361 15203 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e: Bootstrap starting.
I20260806 15:56:04.422425 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260806 15:56:04.424990 15203 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:04.425727 15203 log.cc:824] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:04.427711 15203 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e: No bootstrap required, opened a new log
I20260806 15:56:04.432379 15203 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ba81bb4a42c4575a61f38028abaab1e" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 44073 } }
I20260806 15:56:04.432662 15203 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:56:04.432723 15203 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ba81bb4a42c4575a61f38028abaab1e, State: Initialized, Role: FOLLOWER
I20260806 15:56:04.433194 15203 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ba81bb4a42c4575a61f38028abaab1e" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 44073 } }
I20260806 15:56:04.433326 15203 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:56:04.433408 15203 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:56:04.433506 15203 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:04.434572 15203 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ba81bb4a42c4575a61f38028abaab1e" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 44073 } }
I20260806 15:56:04.434921 15203 leader_election.cc:302] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ba81bb4a42c4575a61f38028abaab1e; no voters:
I20260806 15:56:04.435227 15203 leader_election.cc:288] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:56:04.435467 15208 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:04.435694 15208 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e [term 1 LEADER]: Becoming Leader. State: Replica: 4ba81bb4a42c4575a61f38028abaab1e, State: Running, Role: LEADER
I20260806 15:56:04.436024 15208 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ba81bb4a42c4575a61f38028abaab1e" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 44073 } }
I20260806 15:56:04.436694 15203 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:56:04.437275 15208 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ba81bb4a42c4575a61f38028abaab1e. Latest consensus state: current_term: 1 leader_uuid: "4ba81bb4a42c4575a61f38028abaab1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ba81bb4a42c4575a61f38028abaab1e" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 44073 } } }
I20260806 15:56:04.437402 15208 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e [sys.catalog]: This master's current role is: LEADER
I20260806 15:56:04.437961 15209 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ba81bb4a42c4575a61f38028abaab1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ba81bb4a42c4575a61f38028abaab1e" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 44073 } } }
I20260806 15:56:04.438063 15209 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e [sys.catalog]: This master's current role is: LEADER
I20260806 15:56:04.439287 15213 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:56:04.442022 15213 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:56:04.447573 15213 catalog_manager.cc:1347] Generated new cluster ID: bc5c9e28ff444e2a9f0daeeaab8d5d14
I20260806 15:56:04.447646 15213 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:56:04.459542 15213 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:56:04.460754 15213 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:56:04.470255 15213 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ba81bb4a42c4575a61f38028abaab1e: Generated new TSK 0
I20260806 15:56:04.471040 15213 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:56:04.477875 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.193:0
--local_ip_for_outbound_sockets=127.10.189.193
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:44073
--builtin_ntp_servers=127.10.189.212:41733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=50 with env {}
W20260806 15:56:04.591367 15228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:04.591619 15228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:04.591655 15228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:04.595815 15228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:04.596012 15228 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.193
I20260806 15:56:04.600895 15228 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:41733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=50
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:44073
--never_fsync=true
--heap_profile_path=/tmp/kudu.15228
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.193
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:04.602030 15228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:04.603482 15228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:04.613310 15234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:04.613312 15237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:04.613296 15235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:04.613512 15228 server_base.cc:1034] running on GCE node
I20260806 15:56:04.614220 15228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:04.614873 15228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:04.616044 15228 hybrid_clock.cc:648] HybridClock initialized: now 1786031764616026 us; error 29 us; skew 500 ppm
I20260806 15:56:04.618023 15228 webserver.cc:460] Webserver started at http://127.10.189.193:37949/ using document root <none> and password file <none>
I20260806 15:56:04.618652 15228 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:04.618717 15228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:04.618978 15228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:04.620903 15228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "dae5641066e142d084e63647b997469e"
format_stamp: "Formatted at 2026-08-06 15:56:04 on dist-test-slave-mn4r"
I20260806 15:56:04.621482 15228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "dae5641066e142d084e63647b997469e"
format_stamp: "Formatted at 2026-08-06 15:56:04 on dist-test-slave-mn4r"
I20260806 15:56:04.625401 15228 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 15:56:04.628000 15243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:04.629207 15228 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260806 15:56:04.629340 15228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "dae5641066e142d084e63647b997469e"
format_stamp: "Formatted at 2026-08-06 15:56:04 on dist-test-slave-mn4r"
I20260806 15:56:04.629462 15228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:04.645268 15228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:04.645924 15228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:04.646183 15228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:04.646797 15228 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:04.648046 15228 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:04.648105 15228 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:04.648151 15228 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:04.648169 15228 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:04.657998 15228 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.193:42135
I20260806 15:56:04.658017 15369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.193:42135 every 8 connection(s)
I20260806 15:56:04.659163 15228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260806 15:56:04.664999 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 15228
I20260806 15:56:04.665163 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260806 15:56:04.667392 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.194:0
--local_ip_for_outbound_sockets=127.10.189.194
--webserver_interface=127.10.189.194
--webserver_port=0
--tserver_master_addrs=127.10.189.254:44073
--builtin_ntp_servers=127.10.189.212:41733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=50 with env {}
I20260806 15:56:04.670462 15370 heartbeater.cc:347] Connected to a master server at 127.10.189.254:44073
I20260806 15:56:04.670732 15370 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:04.671319 15370 heartbeater.cc:511] Master 127.10.189.254:44073 requested a full tablet report, sending...
I20260806 15:56:04.673223 15164 ts_manager.cc:194] Registered new tserver with Master: dae5641066e142d084e63647b997469e (127.10.189.193:42135)
I20260806 15:56:04.675115 15164 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.193:34581
W20260806 15:56:04.781730 15373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:04.782004 15373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:04.782039 15373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:04.786248 15373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:04.786337 15373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.194
I20260806 15:56:04.791008 15373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:41733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=50
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.10.189.194
--webserver_port=0
--tserver_master_addrs=127.10.189.254:44073
--never_fsync=true
--heap_profile_path=/tmp/kudu.15373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.194
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:04.792012 15373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:04.793308 15373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:04.802883 15379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:04.802909 15381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:04.802932 15373 server_base.cc:1034] running on GCE node
W20260806 15:56:04.803020 15378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:04.803463 15373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:04.804162 15373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:04.805351 15373 hybrid_clock.cc:648] HybridClock initialized: now 1786031764805333 us; error 28 us; skew 500 ppm
I20260806 15:56:04.807274 15373 webserver.cc:460] Webserver started at http://127.10.189.194:33901/ using document root <none> and password file <none>
I20260806 15:56:04.807891 15373 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:04.807986 15373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:04.808220 15373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:04.810169 15373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "e5e91ee93c9a4145bea6cdd460816b0d"
format_stamp: "Formatted at 2026-08-06 15:56:04 on dist-test-slave-mn4r"
I20260806 15:56:04.810736 15373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "e5e91ee93c9a4145bea6cdd460816b0d"
format_stamp: "Formatted at 2026-08-06 15:56:04 on dist-test-slave-mn4r"
I20260806 15:56:04.814427 15373 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260806 15:56:04.816819 15387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:04.818014 15373 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 15:56:04.818178 15373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "e5e91ee93c9a4145bea6cdd460816b0d"
format_stamp: "Formatted at 2026-08-06 15:56:04 on dist-test-slave-mn4r"
I20260806 15:56:04.818289 15373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:04.831660 15373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:04.832281 15373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:04.832481 15373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:04.833034 15373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:04.834020 15373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:04.834115 15373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:04.834205 15373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:04.834244 15373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:04.843340 15373 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.194:43277
I20260806 15:56:04.843364 15515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.194:43277 every 8 connection(s)
I20260806 15:56:04.844239 15373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260806 15:56:04.844617 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 15373
I20260806 15:56:04.844753 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260806 15:56:04.847234 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.195:0
--local_ip_for_outbound_sockets=127.10.189.195
--webserver_interface=127.10.189.195
--webserver_port=0
--tserver_master_addrs=127.10.189.254:44073
--builtin_ntp_servers=127.10.189.212:41733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=50 with env {}
I20260806 15:56:04.857007 15516 heartbeater.cc:347] Connected to a master server at 127.10.189.254:44073
I20260806 15:56:04.857273 15516 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:04.857811 15516 heartbeater.cc:511] Master 127.10.189.254:44073 requested a full tablet report, sending...
I20260806 15:56:04.858984 15164 ts_manager.cc:194] Registered new tserver with Master: e5e91ee93c9a4145bea6cdd460816b0d (127.10.189.194:43277)
I20260806 15:56:04.859804 15164 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.194:48555
W20260806 15:56:04.961582 15519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:04.961848 15519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:04.961885 15519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:04.965801 15519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:04.965881 15519 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.195
I20260806 15:56:04.970643 15519 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:41733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=50
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.189.195
--webserver_port=0
--tserver_master_addrs=127.10.189.254:44073
--never_fsync=true
--heap_profile_path=/tmp/kudu.15519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.195
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:04.971635 15519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:04.973054 15519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:04.982853 15524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:04.982853 15527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:04.982950 15525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:04.982900 15519 server_base.cc:1034] running on GCE node
I20260806 15:56:04.983467 15519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:04.984182 15519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:04.985371 15519 hybrid_clock.cc:648] HybridClock initialized: now 1786031764985342 us; error 41 us; skew 500 ppm
I20260806 15:56:04.987234 15519 webserver.cc:460] Webserver started at http://127.10.189.195:33551/ using document root <none> and password file <none>
I20260806 15:56:04.987831 15519 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:04.987933 15519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:04.988168 15519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:04.990020 15519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "e3b3ad3178504c20bb4a2d2a71091034"
format_stamp: "Formatted at 2026-08-06 15:56:04 on dist-test-slave-mn4r"
I20260806 15:56:04.990618 15519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "e3b3ad3178504c20bb4a2d2a71091034"
format_stamp: "Formatted at 2026-08-06 15:56:04 on dist-test-slave-mn4r"
I20260806 15:56:04.994208 15519 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 15:56:04.996450 15533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:04.997763 15519 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 15:56:04.997900 15519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "e3b3ad3178504c20bb4a2d2a71091034"
format_stamp: "Formatted at 2026-08-06 15:56:04 on dist-test-slave-mn4r"
I20260806 15:56:04.998020 15519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:05.007215 15519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:05.007802 15519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:05.007994 15519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:05.008526 15519 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:05.009409 15519 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:05.009479 15519 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:05.009550 15519 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:05.009603 15519 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:05.018682 15519 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.195:40143
I20260806 15:56:05.018709 15652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.195:40143 every 8 connection(s)
I20260806 15:56:05.019567 15519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260806 15:56:05.024387 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 15519
I20260806 15:56:05.024510 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260806 15:56:05.026708 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.196:0
--local_ip_for_outbound_sockets=127.10.189.196
--webserver_interface=127.10.189.196
--webserver_port=0
--tserver_master_addrs=127.10.189.254:44073
--builtin_ntp_servers=127.10.189.212:41733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=50 with env {}
I20260806 15:56:05.030536 15653 heartbeater.cc:347] Connected to a master server at 127.10.189.254:44073
I20260806 15:56:05.030781 15653 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:05.031358 15653 heartbeater.cc:511] Master 127.10.189.254:44073 requested a full tablet report, sending...
I20260806 15:56:05.032495 15164 ts_manager.cc:194] Registered new tserver with Master: e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143)
I20260806 15:56:05.033388 15164 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.195:47057
W20260806 15:56:05.139340 15656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:05.139591 15656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:05.139626 15656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:05.143611 15656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:05.143694 15656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.196
I20260806 15:56:05.148257 15656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:41733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=50
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.196:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.10.189.196
--webserver_port=0
--tserver_master_addrs=127.10.189.254:44073
--never_fsync=true
--heap_profile_path=/tmp/kudu.15656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.196
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:05.149257 15656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:05.150702 15656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:05.160311 15662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:05.160297 15664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:05.160490 15661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:05.160817 15656 server_base.cc:1034] running on GCE node
I20260806 15:56:05.161279 15656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:05.161923 15656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:05.163123 15656 hybrid_clock.cc:648] HybridClock initialized: now 1786031765163092 us; error 50 us; skew 500 ppm
I20260806 15:56:05.165076 15656 webserver.cc:460] Webserver started at http://127.10.189.196:38617/ using document root <none> and password file <none>
I20260806 15:56:05.165666 15656 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:05.165759 15656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:05.166014 15656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:05.167949 15656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "523e1bb9a7ce40ceace348732e6bca34"
format_stamp: "Formatted at 2026-08-06 15:56:05 on dist-test-slave-mn4r"
I20260806 15:56:05.168519 15656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "523e1bb9a7ce40ceace348732e6bca34"
format_stamp: "Formatted at 2026-08-06 15:56:05 on dist-test-slave-mn4r"
I20260806 15:56:05.172410 15656 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 15:56:05.174871 15670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:05.176116 15656 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 15:56:05.176250 15656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "523e1bb9a7ce40ceace348732e6bca34"
format_stamp: "Formatted at 2026-08-06 15:56:05 on dist-test-slave-mn4r"
I20260806 15:56:05.176366 15656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:05.198434 15656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:05.199118 15656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:05.199311 15656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:05.200186 15656 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:05.201295 15656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:05.201386 15656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:05.201488 15656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:05.201541 15656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:05.211674 15656 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.196:33801
I20260806 15:56:05.211696 15788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.196:33801 every 8 connection(s)
I20260806 15:56:05.212678 15656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20260806 15:56:05.214007 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 15656
I20260806 15:56:05.214184 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20260806 15:56:05.216969 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.197:0
--local_ip_for_outbound_sockets=127.10.189.197
--webserver_interface=127.10.189.197
--webserver_port=0
--tserver_master_addrs=127.10.189.254:44073
--builtin_ntp_servers=127.10.189.212:41733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=50 with env {}
I20260806 15:56:05.226411 15789 heartbeater.cc:347] Connected to a master server at 127.10.189.254:44073
I20260806 15:56:05.226651 15789 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:05.227172 15789 heartbeater.cc:511] Master 127.10.189.254:44073 requested a full tablet report, sending...
I20260806 15:56:05.228189 15164 ts_manager.cc:194] Registered new tserver with Master: 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801)
I20260806 15:56:05.228761 15164 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.196:54159
W20260806 15:56:05.340732 15797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:05.341017 15797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:05.341084 15797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:05.345331 15797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:05.345465 15797 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.197
I20260806 15:56:05.351017 15797 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:41733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=50
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.197:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.10.189.197
--webserver_port=0
--tserver_master_addrs=127.10.189.254:44073
--never_fsync=true
--heap_profile_path=/tmp/kudu.15797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.197
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:05.352479 15797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:05.354431 15797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:05.364182 15803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:05.364184 15802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:05.364390 15805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:05.364475 15797 server_base.cc:1034] running on GCE node
I20260806 15:56:05.364930 15797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:05.365566 15797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:05.366747 15797 hybrid_clock.cc:648] HybridClock initialized: now 1786031765366716 us; error 42 us; skew 500 ppm
I20260806 15:56:05.368557 15797 webserver.cc:460] Webserver started at http://127.10.189.197:36951/ using document root <none> and password file <none>
I20260806 15:56:05.369175 15797 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:05.369269 15797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:05.369496 15797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:05.371423 15797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "7a401814ff5840b38259456e3d52fbf9"
format_stamp: "Formatted at 2026-08-06 15:56:05 on dist-test-slave-mn4r"
I20260806 15:56:05.371966 15797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "7a401814ff5840b38259456e3d52fbf9"
format_stamp: "Formatted at 2026-08-06 15:56:05 on dist-test-slave-mn4r"
I20260806 15:56:05.375560 15797 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 15:56:05.377775 15811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:05.379045 15797 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 15:56:05.379173 15797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "7a401814ff5840b38259456e3d52fbf9"
format_stamp: "Formatted at 2026-08-06 15:56:05 on dist-test-slave-mn4r"
I20260806 15:56:05.379331 15797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:05.399032 15797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:05.399713 15797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:05.399910 15797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:05.400524 15797 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:05.401505 15797 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:05.401573 15797 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:05.401651 15797 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:05.401693 15797 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:05.411476 15797 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.197:34483
I20260806 15:56:05.411502 15927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.197:34483 every 8 connection(s)
I20260806 15:56:05.412410 15797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20260806 15:56:05.415056 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 15797
I20260806 15:56:05.415176 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20260806 15:56:05.424355 15928 heartbeater.cc:347] Connected to a master server at 127.10.189.254:44073
I20260806 15:56:05.424602 15928 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:05.425184 15928 heartbeater.cc:511] Master 127.10.189.254:44073 requested a full tablet report, sending...
I20260806 15:56:05.426282 15164 ts_manager.cc:194] Registered new tserver with Master: 7a401814ff5840b38259456e3d52fbf9 (127.10.189.197:34483)
I20260806 15:56:05.427006 15164 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.197:42945
I20260806 15:56:05.429430 10999 external_mini_cluster.cc:930] 5 TS(s) registered with all masters
I20260806 15:56:05.439091 15164 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49438:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 5
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
W20260806 15:56:05.442175 15164 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 6 tablet servers would be needed, 5 are available. Consider bringing up more tablet servers.
I20260806 15:56:05.462277 15301 tablet_service.cc:1467] Processing CreateTablet for tablet d6a9aa60c3ba4e29b1e4f81700986dfc (DEFAULT_TABLE table=TestTable [id=0480367b5eb64af6ab39906d2df4ec85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:05.462276 15438 tablet_service.cc:1467] Processing CreateTablet for tablet d6a9aa60c3ba4e29b1e4f81700986dfc (DEFAULT_TABLE table=TestTable [id=0480367b5eb64af6ab39906d2df4ec85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:05.463476 15438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6a9aa60c3ba4e29b1e4f81700986dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:05.463479 15301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6a9aa60c3ba4e29b1e4f81700986dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:05.464605 15718 tablet_service.cc:1467] Processing CreateTablet for tablet d6a9aa60c3ba4e29b1e4f81700986dfc (DEFAULT_TABLE table=TestTable [id=0480367b5eb64af6ab39906d2df4ec85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:05.465684 15718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6a9aa60c3ba4e29b1e4f81700986dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:05.466485 15859 tablet_service.cc:1467] Processing CreateTablet for tablet d6a9aa60c3ba4e29b1e4f81700986dfc (DEFAULT_TABLE table=TestTable [id=0480367b5eb64af6ab39906d2df4ec85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:05.466560 15583 tablet_service.cc:1467] Processing CreateTablet for tablet d6a9aa60c3ba4e29b1e4f81700986dfc (DEFAULT_TABLE table=TestTable [id=0480367b5eb64af6ab39906d2df4ec85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:05.467504 15859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6a9aa60c3ba4e29b1e4f81700986dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:05.467573 15583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6a9aa60c3ba4e29b1e4f81700986dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:05.472474 15950 tablet_bootstrap.cc:492] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34: Bootstrap starting.
I20260806 15:56:05.474507 15951 tablet_bootstrap.cc:492] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9: Bootstrap starting.
I20260806 15:56:05.474910 15950 tablet_bootstrap.cc:654] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:05.475890 15949 tablet_bootstrap.cc:492] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d: Bootstrap starting.
I20260806 15:56:05.476198 15950 log.cc:824] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:05.476675 15951 tablet_bootstrap.cc:654] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:05.477538 15951 log.cc:824] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:05.477674 15952 tablet_bootstrap.cc:492] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034: Bootstrap starting.
I20260806 15:56:05.478726 15949 tablet_bootstrap.cc:654] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:05.479588 15951 tablet_bootstrap.cc:492] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9: No bootstrap required, opened a new log
I20260806 15:56:05.479743 15949 log.cc:824] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:05.479764 15955 tablet_bootstrap.cc:492] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e: Bootstrap starting.
I20260806 15:56:05.479796 15951 ts_tablet_manager.cc:1397] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260806 15:56:05.480160 15952 tablet_bootstrap.cc:654] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:05.481783 15949 tablet_bootstrap.cc:492] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d: No bootstrap required, opened a new log
I20260806 15:56:05.481854 15950 tablet_bootstrap.cc:492] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34: No bootstrap required, opened a new log
I20260806 15:56:05.481984 15955 tablet_bootstrap.cc:654] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:05.482020 15949 ts_tablet_manager.cc:1397] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 15:56:05.482043 15950 ts_tablet_manager.cc:1397] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260806 15:56:05.482846 15955 log.cc:824] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:05.484793 15955 tablet_bootstrap.cc:492] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e: No bootstrap required, opened a new log
I20260806 15:56:05.484735 15951 raft_consensus.cc:348] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:05.485004 15955 ts_tablet_manager.cc:1397] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260806 15:56:05.485016 15951 raft_consensus.cc:374] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:56:05.485069 15951 raft_consensus.cc:729] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a401814ff5840b38259456e3d52fbf9, State: Initialized, Role: FOLLOWER
I20260806 15:56:05.485576 15951 consensus_queue.cc:260] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:05.486433 15949 raft_consensus.cc:348] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:05.486644 15951 ts_tablet_manager.cc:1428] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9: Time spent starting tablet: real 0.007s user 0.000s sys 0.007s
I20260806 15:56:05.486678 15949 raft_consensus.cc:374] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:56:05.486730 15949 raft_consensus.cc:729] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5e91ee93c9a4145bea6cdd460816b0d, State: Initialized, Role: FOLLOWER
I20260806 15:56:05.486984 15928 heartbeater.cc:503] Master 127.10.189.254:44073 was elected leader, sending a full tablet report...
I20260806 15:56:05.487284 15949 consensus_queue.cc:260] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:05.487505 15950 raft_consensus.cc:348] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:05.487761 15950 raft_consensus.cc:374] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:56:05.487810 15950 raft_consensus.cc:729] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523e1bb9a7ce40ceace348732e6bca34, State: Initialized, Role: FOLLOWER
I20260806 15:56:05.488317 15949 ts_tablet_manager.cc:1428] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 15:56:05.488261 15950 consensus_queue.cc:260] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:05.488623 15516 heartbeater.cc:503] Master 127.10.189.254:44073 was elected leader, sending a full tablet report...
I20260806 15:56:05.488786 15952 log.cc:824] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:05.489173 15950 ts_tablet_manager.cc:1428] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260806 15:56:05.489257 15955 raft_consensus.cc:348] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:05.489490 15789 heartbeater.cc:503] Master 127.10.189.254:44073 was elected leader, sending a full tablet report...
I20260806 15:56:05.489507 15955 raft_consensus.cc:374] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:56:05.489576 15955 raft_consensus.cc:729] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dae5641066e142d084e63647b997469e, State: Initialized, Role: FOLLOWER
I20260806 15:56:05.490844 15955 consensus_queue.cc:260] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:05.491597 15952 tablet_bootstrap.cc:492] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034: No bootstrap required, opened a new log
I20260806 15:56:05.491716 15955 ts_tablet_manager.cc:1428] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260806 15:56:05.491879 15952 ts_tablet_manager.cc:1397] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.000s
I20260806 15:56:05.492027 15370 heartbeater.cc:503] Master 127.10.189.254:44073 was elected leader, sending a full tablet report...
I20260806 15:56:05.496626 15952 raft_consensus.cc:348] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:05.496888 15952 raft_consensus.cc:374] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:56:05.496965 15952 raft_consensus.cc:729] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b3ad3178504c20bb4a2d2a71091034, State: Initialized, Role: FOLLOWER
I20260806 15:56:05.497365 15952 consensus_queue.cc:260] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:05.497999 15653 heartbeater.cc:503] Master 127.10.189.254:44073 was elected leader, sending a full tablet report...
I20260806 15:56:05.498253 15952 ts_tablet_manager.cc:1428] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260806 15:56:05.520761 15654 tablet.cc:2369] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:56:05.556773 15960 raft_consensus.cc:482] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:56:05.557035 15960 raft_consensus.cc:504] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:05.559571 15960 leader_election.cc:288] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dae5641066e142d084e63647b997469e (127.10.189.193:42135), e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143), e5e91ee93c9a4145bea6cdd460816b0d (127.10.189.194:43277), 7a401814ff5840b38259456e3d52fbf9 (127.10.189.197:34483)
I20260806 15:56:05.565913 15322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "523e1bb9a7ce40ceace348732e6bca34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dae5641066e142d084e63647b997469e" is_pre_election: true
I20260806 15:56:05.566306 15322 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 523e1bb9a7ce40ceace348732e6bca34 in term 0.
I20260806 15:56:05.566886 15605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "523e1bb9a7ce40ceace348732e6bca34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b3ad3178504c20bb4a2d2a71091034" is_pre_election: true
I20260806 15:56:05.567175 15605 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 523e1bb9a7ce40ceace348732e6bca34 in term 0.
I20260806 15:56:05.567823 15672 leader_election.cc:302] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 523e1bb9a7ce40ceace348732e6bca34, dae5641066e142d084e63647b997469e, e3b3ad3178504c20bb4a2d2a71091034; no voters:
I20260806 15:56:05.568183 15960 raft_consensus.cc:2781] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:56:05.568291 15960 raft_consensus.cc:482] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:56:05.568341 15960 raft_consensus.cc:3037] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:05.569823 15960 raft_consensus.cc:504] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:05.570426 15960 leader_election.cc:288] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [CANDIDATE]: Term 1 election: Requested vote from peers dae5641066e142d084e63647b997469e (127.10.189.193:42135), e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143), e5e91ee93c9a4145bea6cdd460816b0d (127.10.189.194:43277), 7a401814ff5840b38259456e3d52fbf9 (127.10.189.197:34483)
I20260806 15:56:05.570587 15882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "523e1bb9a7ce40ceace348732e6bca34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a401814ff5840b38259456e3d52fbf9" is_pre_election: true
I20260806 15:56:05.570904 15882 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 523e1bb9a7ce40ceace348732e6bca34 in term 0.
I20260806 15:56:05.570971 15322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "523e1bb9a7ce40ceace348732e6bca34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dae5641066e142d084e63647b997469e"
I20260806 15:56:05.571098 15322 raft_consensus.cc:3037] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:05.571552 15882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "523e1bb9a7ce40ceace348732e6bca34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a401814ff5840b38259456e3d52fbf9"
I20260806 15:56:05.571664 15882 raft_consensus.cc:3037] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:05.571960 15605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "523e1bb9a7ce40ceace348732e6bca34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b3ad3178504c20bb4a2d2a71091034"
I20260806 15:56:05.572129 15605 raft_consensus.cc:3037] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:05.572347 15322 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 523e1bb9a7ce40ceace348732e6bca34 in term 1.
I20260806 15:56:05.572752 15460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "523e1bb9a7ce40ceace348732e6bca34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" is_pre_election: true
I20260806 15:56:05.572870 15882 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 523e1bb9a7ce40ceace348732e6bca34 in term 1.
I20260806 15:56:05.573058 15460 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 523e1bb9a7ce40ceace348732e6bca34 in term 0.
I20260806 15:56:05.573378 15605 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 523e1bb9a7ce40ceace348732e6bca34 in term 1.
I20260806 15:56:05.573437 15459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "523e1bb9a7ce40ceace348732e6bca34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e91ee93c9a4145bea6cdd460816b0d"
I20260806 15:56:05.573576 15459 raft_consensus.cc:3037] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:05.573707 15672 leader_election.cc:302] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 523e1bb9a7ce40ceace348732e6bca34, 7a401814ff5840b38259456e3d52fbf9, e3b3ad3178504c20bb4a2d2a71091034; no voters:
I20260806 15:56:05.573872 15960 raft_consensus.cc:2781] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:05.574067 15960 raft_consensus.cc:686] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [term 1 LEADER]: Becoming Leader. State: Replica: 523e1bb9a7ce40ceace348732e6bca34, State: Running, Role: LEADER
I20260806 15:56:05.574479 15960 consensus_queue.cc:237] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:05.574808 15459 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 523e1bb9a7ce40ceace348732e6bca34 in term 1.
I20260806 15:56:05.579154 15164 catalog_manager.cc:5495] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 reported cstate change: term changed from 0 to 1, leader changed from <none> to 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196). New cstate: current_term: 1 leader_uuid: "523e1bb9a7ce40ceace348732e6bca34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } health_report { overall_health: UNKNOWN } } }
W20260806 15:56:05.595939 15517 tablet.cc:2369] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:56:05.614959 10999 external_mini_cluster.cc:930] 5 TS(s) registered with all masters
I20260806 15:56:05.616398 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver dae5641066e142d084e63647b997469e to finish bootstrapping
I20260806 15:56:05.623018 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver e5e91ee93c9a4145bea6cdd460816b0d to finish bootstrapping
I20260806 15:56:05.628134 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver e3b3ad3178504c20bb4a2d2a71091034 to finish bootstrapping
I20260806 15:56:05.633500 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 523e1bb9a7ce40ceace348732e6bca34 to finish bootstrapping
I20260806 15:56:05.639225 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 7a401814ff5840b38259456e3d52fbf9 to finish bootstrapping
I20260806 15:56:05.650920 10999 raft_consensus_election-itest.cc:397] Writing data to leader of 5-node config (5 alive)...
W20260806 15:56:05.660797 15371 tablet.cc:2369] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 15:56:05.663365 15929 tablet.cc:2369] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:56:05.666380 15882 raft_consensus.cc:1261] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 1 FOLLOWER]: Refusing update from remote peer 523e1bb9a7ce40ceace348732e6bca34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:56:05.666381 15459 raft_consensus.cc:1261] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 1 FOLLOWER]: Refusing update from remote peer 523e1bb9a7ce40ceace348732e6bca34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:56:05.666381 15605 raft_consensus.cc:1261] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [term 1 FOLLOWER]: Refusing update from remote peer 523e1bb9a7ce40ceace348732e6bca34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:56:05.666380 15322 raft_consensus.cc:1261] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 1 FOLLOWER]: Refusing update from remote peer 523e1bb9a7ce40ceace348732e6bca34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:56:05.667130 15967 consensus_queue.cc:1035] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:56:05.667428 15973 consensus_queue.cc:1035] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:56:05.667572 15960 consensus_queue.cc:1035] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:56:05.667657 15974 consensus_queue.cc:1035] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:56:05.677027 15972 mvcc.cc:205] Tried to move back new op lower bound from 7315586112161722368 to 7315586111797264384. Current Snapshot: MvccSnapshot[applied={T|T < 7315586112161722368}]
I20260806 15:56:05.680645 15978 mvcc.cc:205] Tried to move back new op lower bound from 7315586112161722368 to 7315586111797264384. Current Snapshot: MvccSnapshot[applied={T|T < 7315586112161722368}]
I20260806 15:56:05.680810 15976 mvcc.cc:205] Tried to move back new op lower bound from 7315586112161722368 to 7315586111797264384. Current Snapshot: MvccSnapshot[applied={T|T < 7315586112161722368}]
I20260806 15:56:05.705639 10999 raft_consensus_election-itest.cc:408] Killing current leader 523e1bb9a7ce40ceace348732e6bca34...
I20260806 15:56:05.705753 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 15656
W20260806 15:56:05.713737 15391 connection.cc:535] server connection from 127.10.189.196:52353 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 15:56:05.714568 10999 raft_consensus_election-itest.cc:412] Waiting for new guy to be elected leader.
I20260806 15:56:05.716405 10999 test_util.cc:268] Using random seed: -319554133
I20260806 15:56:05.836251 10999 test_util.cc:268] Using random seed: -319434294
I20260806 15:56:06.042742 10999 test_util.cc:268] Using random seed: -319227795
I20260806 15:56:06.349198 10999 test_util.cc:268] Using random seed: -318921340
I20260806 15:56:06.756043 10999 test_util.cc:268] Using random seed: -318514494
I20260806 15:56:07.205240 15991 raft_consensus.cc:482] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 523e1bb9a7ce40ceace348732e6bca34)
I20260806 15:56:07.205420 15991 raft_consensus.cc:504] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:07.205853 15992 raft_consensus.cc:482] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 523e1bb9a7ce40ceace348732e6bca34)
I20260806 15:56:07.206022 15992 raft_consensus.cc:504] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:07.206290 15993 raft_consensus.cc:482] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 523e1bb9a7ce40ceace348732e6bca34)
I20260806 15:56:07.206406 15993 raft_consensus.cc:504] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:07.206501 15994 raft_consensus.cc:482] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 523e1bb9a7ce40ceace348732e6bca34)
I20260806 15:56:07.206723 15994 raft_consensus.cc:504] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:07.207787 15991 leader_election.cc:288] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801), e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143), e5e91ee93c9a4145bea6cdd460816b0d (127.10.189.194:43277), 7a401814ff5840b38259456e3d52fbf9 (127.10.189.197:34483)
W20260806 15:56:07.209188 15250 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.189.196:33801: connect: Connection refused (error 111)
I20260806 15:56:07.209942 15993 leader_election.cc:288] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dae5641066e142d084e63647b997469e (127.10.189.193:42135), 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801), e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143), e5e91ee93c9a4145bea6cdd460816b0d (127.10.189.194:43277)
I20260806 15:56:07.210728 15992 leader_election.cc:288] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dae5641066e142d084e63647b997469e (127.10.189.193:42135), 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801), e5e91ee93c9a4145bea6cdd460816b0d (127.10.189.194:43277), 7a401814ff5840b38259456e3d52fbf9 (127.10.189.197:34483)
I20260806 15:56:07.211270 15994 leader_election.cc:288] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dae5641066e142d084e63647b997469e (127.10.189.193:42135), 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801), e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143), 7a401814ff5840b38259456e3d52fbf9 (127.10.189.197:34483)
W20260806 15:56:07.214124 15537 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.189.196:33801: connect: Connection refused (error 111)
W20260806 15:56:07.214154 15815 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.189.196:33801: connect: Connection refused (error 111)
I20260806 15:56:07.216252 15459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "e3b3ad3178504c20bb4a2d2a71091034" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" is_pre_election: true
I20260806 15:56:07.216331 15322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "e3b3ad3178504c20bb4a2d2a71091034" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "dae5641066e142d084e63647b997469e" is_pre_election: true
I20260806 15:56:07.216393 15459 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b3ad3178504c20bb4a2d2a71091034 in term 1.
I20260806 15:56:07.216440 15322 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b3ad3178504c20bb4a2d2a71091034 in term 1.
I20260806 15:56:07.217065 15534 leader_election.cc:302] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: dae5641066e142d084e63647b997469e, e3b3ad3178504c20bb4a2d2a71091034, e5e91ee93c9a4145bea6cdd460816b0d; no voters:
W20260806 15:56:07.217756 15537 leader_election.cc:334] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801): Network error: Client connection negotiation failed: client connection to 127.10.189.196:33801: connect: Connection refused (error 111)
I20260806 15:56:07.217948 15992 raft_consensus.cc:2781] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260806 15:56:07.218019 15992 raft_consensus.cc:482] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 523e1bb9a7ce40ceace348732e6bca34)
I20260806 15:56:07.218094 15992 raft_consensus.cc:3037] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:07.219376 15992 raft_consensus.cc:504] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:07.219915 15992 leader_election.cc:288] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [CANDIDATE]: Term 2 election: Requested vote from peers dae5641066e142d084e63647b997469e (127.10.189.193:42135), 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801), e5e91ee93c9a4145bea6cdd460816b0d (127.10.189.194:43277), 7a401814ff5840b38259456e3d52fbf9 (127.10.189.197:34483)
I20260806 15:56:07.220332 15459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "e3b3ad3178504c20bb4a2d2a71091034" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "e5e91ee93c9a4145bea6cdd460816b0d"
I20260806 15:56:07.220332 15322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "e3b3ad3178504c20bb4a2d2a71091034" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "dae5641066e142d084e63647b997469e"
I20260806 15:56:07.220449 15459 raft_consensus.cc:3037] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:07.220458 15322 raft_consensus.cc:3037] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:07.221501 15322 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b3ad3178504c20bb4a2d2a71091034 in term 2.
I20260806 15:56:07.221501 15459 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b3ad3178504c20bb4a2d2a71091034 in term 2.
I20260806 15:56:07.222044 15534 leader_election.cc:302] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: dae5641066e142d084e63647b997469e, e3b3ad3178504c20bb4a2d2a71091034, e5e91ee93c9a4145bea6cdd460816b0d; no voters:
I20260806 15:56:07.222216 15992 raft_consensus.cc:2781] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 15:56:07.222430 15992 raft_consensus.cc:686] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [term 2 LEADER]: Becoming Leader. State: Replica: e3b3ad3178504c20bb4a2d2a71091034, State: Running, Role: LEADER
I20260806 15:56:07.222779 15992 consensus_queue.cc:237] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:07.223335 15882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "dae5641066e142d084e63647b997469e" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "7a401814ff5840b38259456e3d52fbf9" is_pre_election: true
I20260806 15:56:07.223531 15882 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dae5641066e142d084e63647b997469e in term 1.
W20260806 15:56:07.224231 15537 leader_election.cc:334] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801): Network error: Client connection negotiation failed: client connection to 127.10.189.196:33801: connect: Connection refused (error 111)
I20260806 15:56:07.224547 15605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "dae5641066e142d084e63647b997469e" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "e3b3ad3178504c20bb4a2d2a71091034" is_pre_election: true
I20260806 15:56:07.224992 15322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "7a401814ff5840b38259456e3d52fbf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "dae5641066e142d084e63647b997469e" is_pre_election: true
I20260806 15:56:07.225170 15322 raft_consensus.cc:2379] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a401814ff5840b38259456e3d52fbf9 in current term 2: Already voted for candidate e3b3ad3178504c20bb4a2d2a71091034 in this term.
W20260806 15:56:07.225715 15815 leader_election.cc:334] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801): Network error: Client connection negotiation failed: client connection to 127.10.189.196:33801: connect: Connection refused (error 111)
I20260806 15:56:07.225687 15159 catalog_manager.cc:5495] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 reported cstate change: term changed from 1 to 2, leader changed from 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196) to e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195). New cstate: current_term: 2 leader_uuid: "e3b3ad3178504c20bb4a2d2a71091034" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } health_report { overall_health: UNKNOWN } } }
W20260806 15:56:07.226317 15391 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.189.196:33801: connect: Connection refused (error 111)
W20260806 15:56:07.226536 15250 leader_election.cc:334] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801): Network error: Client connection negotiation failed: client connection to 127.10.189.196:33801: connect: Connection refused (error 111)
I20260806 15:56:07.226617 15459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "dae5641066e142d084e63647b997469e" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" is_pre_election: true
I20260806 15:56:07.226778 15459 raft_consensus.cc:2379] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dae5641066e142d084e63647b997469e in current term 2: Already voted for candidate e3b3ad3178504c20bb4a2d2a71091034 in this term.
I20260806 15:56:07.226941 15322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "dae5641066e142d084e63647b997469e" is_pre_election: true
I20260806 15:56:07.227080 15322 raft_consensus.cc:2379] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5e91ee93c9a4145bea6cdd460816b0d in current term 2: Already voted for candidate e3b3ad3178504c20bb4a2d2a71091034 in this term.
I20260806 15:56:07.227133 15245 leader_election.cc:302] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 5 voters: 2 yes votes; 3 no votes. yes voters: 7a401814ff5840b38259456e3d52fbf9, dae5641066e142d084e63647b997469e; no voters: 523e1bb9a7ce40ceace348732e6bca34, e3b3ad3178504c20bb4a2d2a71091034, e5e91ee93c9a4145bea6cdd460816b0d
I20260806 15:56:07.227599 15991 raft_consensus.cc:2726] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:56:07.227859 15605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "7a401814ff5840b38259456e3d52fbf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "e3b3ad3178504c20bb4a2d2a71091034" is_pre_election: true
I20260806 15:56:07.228258 15813 leader_election.cc:302] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 7a401814ff5840b38259456e3d52fbf9; no voters: 523e1bb9a7ce40ceace348732e6bca34, dae5641066e142d084e63647b997469e, e3b3ad3178504c20bb4a2d2a71091034
W20260806 15:56:07.228404 15391 leader_election.cc:334] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801): Network error: Client connection negotiation failed: client connection to 127.10.189.196:33801: connect: Connection refused (error 111)
I20260806 15:56:07.228657 15993 raft_consensus.cc:3037] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:07.228732 15459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "7a401814ff5840b38259456e3d52fbf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" is_pre_election: true
I20260806 15:56:07.228875 15459 raft_consensus.cc:2379] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a401814ff5840b38259456e3d52fbf9 in current term 2: Already voted for candidate e3b3ad3178504c20bb4a2d2a71091034 in this term.
I20260806 15:56:07.229874 15993 raft_consensus.cc:2726] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:56:07.231508 15882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "e3b3ad3178504c20bb4a2d2a71091034" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "7a401814ff5840b38259456e3d52fbf9" is_pre_election: true
I20260806 15:56:07.231650 15882 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b3ad3178504c20bb4a2d2a71091034 in term 2.
I20260806 15:56:07.231662 15881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "e3b3ad3178504c20bb4a2d2a71091034" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "7a401814ff5840b38259456e3d52fbf9"
I20260806 15:56:07.233445 15881 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b3ad3178504c20bb4a2d2a71091034 in term 2.
I20260806 15:56:07.233419 15605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "e3b3ad3178504c20bb4a2d2a71091034" is_pre_election: true
I20260806 15:56:07.233811 15389 leader_election.cc:302] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: e5e91ee93c9a4145bea6cdd460816b0d; no voters: 523e1bb9a7ce40ceace348732e6bca34, dae5641066e142d084e63647b997469e, e3b3ad3178504c20bb4a2d2a71091034
I20260806 15:56:07.234160 15994 raft_consensus.cc:2726] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:56:07.234921 15881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "7a401814ff5840b38259456e3d52fbf9" is_pre_election: true
I20260806 15:56:07.235118 15881 raft_consensus.cc:2379] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5e91ee93c9a4145bea6cdd460816b0d in current term 2: Already voted for candidate e3b3ad3178504c20bb4a2d2a71091034 in this term.
I20260806 15:56:07.263341 10999 raft_consensus_election-itest.cc:397] Writing data to leader of 5-node config (4 alive)...
W20260806 15:56:07.266237 15934 meta_cache.cc:302] tablet d6a9aa60c3ba4e29b1e4f81700986dfc: replica 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801) has failed: Network error: Client connection negotiation failed: client connection to 127.10.189.196:33801: connect: Connection refused (error 111)
W20260806 15:56:07.273993 15279 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:32992: Illegal state: replica dae5641066e142d084e63647b997469e is not leader of this config: current role FOLLOWER
I20260806 15:56:07.287288 15459 raft_consensus.cc:1261] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 2 FOLLOWER]: Refusing update from remote peer e3b3ad3178504c20bb4a2d2a71091034: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260806 15:56:07.287303 15322 raft_consensus.cc:1261] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 2 FOLLOWER]: Refusing update from remote peer e3b3ad3178504c20bb4a2d2a71091034: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260806 15:56:07.287320 15881 raft_consensus.cc:1261] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 2 FOLLOWER]: Refusing update from remote peer e3b3ad3178504c20bb4a2d2a71091034: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260806 15:56:07.287823 16036 consensus_queue.cc:1035] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260806 15:56:07.287981 15992 consensus_queue.cc:1035] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260806 15:56:07.288103 16037 consensus_queue.cc:1035] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260806 15:56:07.288398 15537 consensus_peers.cc:487] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 -> Peer 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801): Couldn't send request to peer 523e1bb9a7ce40ceace348732e6bca34. Status: Network error: Client connection negotiation failed: client connection to 127.10.189.196:33801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 15:56:07.294620 16040 mvcc.cc:205] Tried to move back new op lower bound from 7315586118802731008 to 7315586118548226048. Current Snapshot: MvccSnapshot[applied={T|T < 7315586118802731008}]
I20260806 15:56:07.297962 16041 mvcc.cc:205] Tried to move back new op lower bound from 7315586118802731008 to 7315586118548226048. Current Snapshot: MvccSnapshot[applied={T|T < 7315586118802731008 or (T in {7315586118802731008})}]
I20260806 15:56:07.314101 10999 raft_consensus_election-itest.cc:408] Killing current leader e3b3ad3178504c20bb4a2d2a71091034...
I20260806 15:56:07.314208 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 15519
I20260806 15:56:07.322309 10999 raft_consensus_election-itest.cc:412] Waiting for new guy to be elected leader.
I20260806 15:56:07.324223 10999 test_util.cc:268] Using random seed: -317946310
I20260806 15:56:07.430408 10999 test_util.cc:268] Using random seed: -317840129
I20260806 15:56:07.636562 10999 test_util.cc:268] Using random seed: -317633977
I20260806 15:56:07.943137 10999 test_util.cc:268] Using random seed: -317327401
I20260806 15:56:08.349527 10999 test_util.cc:268] Using random seed: -316921010
I20260806 15:56:08.813547 16052 raft_consensus.cc:482] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3b3ad3178504c20bb4a2d2a71091034)
I20260806 15:56:08.813773 16052 raft_consensus.cc:504] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:08.813922 16053 raft_consensus.cc:482] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3b3ad3178504c20bb4a2d2a71091034)
I20260806 15:56:08.814111 16054 raft_consensus.cc:482] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3b3ad3178504c20bb4a2d2a71091034)
I20260806 15:56:08.814117 16053 raft_consensus.cc:504] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:08.814263 16054 raft_consensus.cc:504] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:08.815341 15322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "dae5641066e142d084e63647b997469e" is_pre_election: true
I20260806 15:56:08.815410 15881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "7a401814ff5840b38259456e3d52fbf9" is_pre_election: true
I20260806 15:56:08.815508 15322 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5e91ee93c9a4145bea6cdd460816b0d in term 2.
I20260806 15:56:08.815564 15881 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5e91ee93c9a4145bea6cdd460816b0d in term 2.
I20260806 15:56:08.816011 15390 leader_election.cc:302] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 7a401814ff5840b38259456e3d52fbf9, dae5641066e142d084e63647b997469e, e5e91ee93c9a4145bea6cdd460816b0d; no voters:
I20260806 15:56:08.816187 16054 leader_election.cc:288] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dae5641066e142d084e63647b997469e (127.10.189.193:42135), 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801), e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143), e5e91ee93c9a4145bea6cdd460816b0d (127.10.189.194:43277)
I20260806 15:56:08.816540 15459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "dae5641066e142d084e63647b997469e" candidate_term: 3 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" is_pre_election: true
I20260806 15:56:08.816622 15881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "dae5641066e142d084e63647b997469e" candidate_term: 3 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "7a401814ff5840b38259456e3d52fbf9" is_pre_election: true
I20260806 15:56:08.816676 15459 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dae5641066e142d084e63647b997469e in term 2.
I20260806 15:56:08.816747 15881 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dae5641066e142d084e63647b997469e in term 2.
I20260806 15:56:08.816406 16053 leader_election.cc:288] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801), e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143), e5e91ee93c9a4145bea6cdd460816b0d (127.10.189.194:43277), 7a401814ff5840b38259456e3d52fbf9 (127.10.189.197:34483)
I20260806 15:56:08.817101 15248 leader_election.cc:302] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 7a401814ff5840b38259456e3d52fbf9, dae5641066e142d084e63647b997469e, e5e91ee93c9a4145bea6cdd460816b0d; no voters:
I20260806 15:56:08.817342 15322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "7a401814ff5840b38259456e3d52fbf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "dae5641066e142d084e63647b997469e" is_pre_election: true
I20260806 15:56:08.817337 15459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "7a401814ff5840b38259456e3d52fbf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" is_pre_election: true
W20260806 15:56:08.817354 15391 leader_election.cc:334] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801): Network error: Client connection negotiation failed: client connection to 127.10.189.196:33801: connect: Connection refused (error 111)
I20260806 15:56:08.817462 15322 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a401814ff5840b38259456e3d52fbf9 in term 2.
I20260806 15:56:08.817492 15459 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a401814ff5840b38259456e3d52fbf9 in term 2.
I20260806 15:56:08.817528 16053 raft_consensus.cc:2781] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260806 15:56:08.817569 16053 raft_consensus.cc:482] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3b3ad3178504c20bb4a2d2a71091034)
I20260806 15:56:08.817711 16053 raft_consensus.cc:3037] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 2 FOLLOWER]: Advancing to term 3
I20260806 15:56:08.817865 16052 leader_election.cc:288] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dae5641066e142d084e63647b997469e (127.10.189.193:42135), 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801), e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143), 7a401814ff5840b38259456e3d52fbf9 (127.10.189.197:34483)
I20260806 15:56:08.817981 16052 raft_consensus.cc:2781] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260806 15:56:08.818035 16052 raft_consensus.cc:482] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3b3ad3178504c20bb4a2d2a71091034)
I20260806 15:56:08.818120 16052 raft_consensus.cc:3037] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 2 FOLLOWER]: Advancing to term 3
W20260806 15:56:08.818142 15813 leader_election.cc:334] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143): Network error: Client connection negotiation failed: client connection to 127.10.189.195:40143: connect: Connection refused (error 111)
I20260806 15:56:08.818264 15812 leader_election.cc:302] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 5 voters: 3 yes votes; 1 no votes. yes voters: 7a401814ff5840b38259456e3d52fbf9, dae5641066e142d084e63647b997469e, e5e91ee93c9a4145bea6cdd460816b0d; no voters: e3b3ad3178504c20bb4a2d2a71091034
I20260806 15:56:08.818464 16054 raft_consensus.cc:2781] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260806 15:56:08.818557 16054 raft_consensus.cc:482] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3b3ad3178504c20bb4a2d2a71091034)
I20260806 15:56:08.818651 16054 raft_consensus.cc:3037] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 2 FOLLOWER]: Advancing to term 3
W20260806 15:56:08.818686 15389 leader_election.cc:334] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143): Network error: Client connection negotiation failed: client connection to 127.10.189.195:40143: connect: Connection refused (error 111)
I20260806 15:56:08.819133 16052 raft_consensus.cc:504] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:08.819133 16053 raft_consensus.cc:504] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:08.819620 16052 leader_election.cc:288] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [CANDIDATE]: Term 3 election: Requested vote from peers dae5641066e142d084e63647b997469e (127.10.189.193:42135), 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801), e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143), 7a401814ff5840b38259456e3d52fbf9 (127.10.189.197:34483)
I20260806 15:56:08.820354 15459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "dae5641066e142d084e63647b997469e" candidate_term: 3 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "e5e91ee93c9a4145bea6cdd460816b0d"
I20260806 15:56:08.820372 15322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "dae5641066e142d084e63647b997469e"
I20260806 15:56:08.820505 15322 raft_consensus.cc:2379] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e5e91ee93c9a4145bea6cdd460816b0d in current term 3: Already voted for candidate dae5641066e142d084e63647b997469e in this term.
I20260806 15:56:08.820506 15459 raft_consensus.cc:2379] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dae5641066e142d084e63647b997469e in current term 3: Already voted for candidate e5e91ee93c9a4145bea6cdd460816b0d in this term.
I20260806 15:56:08.820597 15882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "dae5641066e142d084e63647b997469e" candidate_term: 3 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "7a401814ff5840b38259456e3d52fbf9"
I20260806 15:56:08.820662 15881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "7a401814ff5840b38259456e3d52fbf9"
I20260806 15:56:08.820788 16053 leader_election.cc:288] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [CANDIDATE]: Term 3 election: Requested vote from peers 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801), e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143), e5e91ee93c9a4145bea6cdd460816b0d (127.10.189.194:43277), 7a401814ff5840b38259456e3d52fbf9 (127.10.189.197:34483)
W20260806 15:56:08.820935 15246 leader_election.cc:334] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143): Network error: Client connection negotiation failed: client connection to 127.10.189.195:40143: connect: Connection refused (error 111)
W20260806 15:56:08.821170 15250 leader_election.cc:334] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801): Network error: Client connection negotiation failed: client connection to 127.10.189.196:33801: connect: Connection refused (error 111)
W20260806 15:56:08.821313 15815 leader_election.cc:334] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801): Network error: Client connection negotiation failed: client connection to 127.10.189.196:33801: connect: Connection refused (error 111)
W20260806 15:56:08.821437 15389 leader_election.cc:334] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143): Network error: Client connection negotiation failed: client connection to 127.10.189.195:40143: connect: Connection refused (error 111)
I20260806 15:56:08.821523 15389 leader_election.cc:302] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: e5e91ee93c9a4145bea6cdd460816b0d; no voters: 7a401814ff5840b38259456e3d52fbf9, dae5641066e142d084e63647b997469e, e3b3ad3178504c20bb4a2d2a71091034
I20260806 15:56:08.821666 16061 raft_consensus.cc:2726] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260806 15:56:08.821761 15391 leader_election.cc:334] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801): Network error: Client connection negotiation failed: client connection to 127.10.189.196:33801: connect: Connection refused (error 111)
I20260806 15:56:08.821899 16054 raft_consensus.cc:504] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:08.822162 15882 raft_consensus.cc:2379] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dae5641066e142d084e63647b997469e in current term 3: Already voted for candidate 7a401814ff5840b38259456e3d52fbf9 in this term.
W20260806 15:56:08.822480 15246 leader_election.cc:334] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143): Network error: Client connection negotiation failed: client connection to 127.10.189.195:40143: connect: Connection refused (error 111)
I20260806 15:56:08.822661 15322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "7a401814ff5840b38259456e3d52fbf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "dae5641066e142d084e63647b997469e"
I20260806 15:56:08.822803 15322 raft_consensus.cc:2379] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a401814ff5840b38259456e3d52fbf9 in current term 3: Already voted for candidate dae5641066e142d084e63647b997469e in this term.
W20260806 15:56:08.822783 15250 leader_election.cc:334] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801): Network error: Client connection negotiation failed: client connection to 127.10.189.196:33801: connect: Connection refused (error 111)
I20260806 15:56:08.822997 15250 leader_election.cc:302] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: dae5641066e142d084e63647b997469e; no voters: 523e1bb9a7ce40ceace348732e6bca34, e3b3ad3178504c20bb4a2d2a71091034, e5e91ee93c9a4145bea6cdd460816b0d
I20260806 15:56:08.823124 16053 raft_consensus.cc:2726] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260806 15:56:08.823680 16054 leader_election.cc:288] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [CANDIDATE]: Term 3 election: Requested vote from peers dae5641066e142d084e63647b997469e (127.10.189.193:42135), 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801), e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143), e5e91ee93c9a4145bea6cdd460816b0d (127.10.189.194:43277)
W20260806 15:56:08.823758 15815 leader_election.cc:334] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801): Network error: Client connection negotiation failed: client connection to 127.10.189.196:33801: connect: Connection refused (error 111)
I20260806 15:56:08.823837 15459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "7a401814ff5840b38259456e3d52fbf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "e5e91ee93c9a4145bea6cdd460816b0d"
I20260806 15:56:08.823966 15459 raft_consensus.cc:2379] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a401814ff5840b38259456e3d52fbf9 in current term 3: Already voted for candidate e5e91ee93c9a4145bea6cdd460816b0d in this term.
W20260806 15:56:08.824051 15813 leader_election.cc:334] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143): Network error: Client connection negotiation failed: client connection to 127.10.189.195:40143: connect: Connection refused (error 111)
I20260806 15:56:08.824127 15813 leader_election.cc:302] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 7a401814ff5840b38259456e3d52fbf9; no voters: 523e1bb9a7ce40ceace348732e6bca34, dae5641066e142d084e63647b997469e, e3b3ad3178504c20bb4a2d2a71091034
I20260806 15:56:08.824271 16054 raft_consensus.cc:2726] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260806 15:56:08.855643 10999 test_util.cc:268] Using random seed: -316414895
I20260806 15:56:09.461994 10999 test_util.cc:268] Using random seed: -315808544
I20260806 15:56:10.168829 10999 test_util.cc:268] Using random seed: -315101716
I20260806 15:56:10.545249 16069 raft_consensus.cc:482] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:56:10.545390 16069 raft_consensus.cc:504] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:10.545975 16069 leader_election.cc:288] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dae5641066e142d084e63647b997469e (127.10.189.193:42135), 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801), e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143), 7a401814ff5840b38259456e3d52fbf9 (127.10.189.197:34483)
I20260806 15:56:10.546492 15322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "dae5641066e142d084e63647b997469e" is_pre_election: true
I20260806 15:56:10.546531 15882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "7a401814ff5840b38259456e3d52fbf9" is_pre_election: true
I20260806 15:56:10.546658 15322 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5e91ee93c9a4145bea6cdd460816b0d in term 3.
I20260806 15:56:10.546658 15882 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5e91ee93c9a4145bea6cdd460816b0d in term 3.
I20260806 15:56:10.547071 15390 leader_election.cc:302] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 7a401814ff5840b38259456e3d52fbf9, dae5641066e142d084e63647b997469e, e5e91ee93c9a4145bea6cdd460816b0d; no voters:
I20260806 15:56:10.547351 16069 raft_consensus.cc:2781] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260806 15:56:10.547429 16069 raft_consensus.cc:482] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260806 15:56:10.547457 15391 leader_election.cc:334] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801): Network error: Client connection negotiation failed: client connection to 127.10.189.196:33801: connect: Connection refused (error 111)
I20260806 15:56:10.547513 16069 raft_consensus.cc:3037] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 3 FOLLOWER]: Advancing to term 4
W20260806 15:56:10.547573 15389 leader_election.cc:334] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143): Network error: Client connection negotiation failed: client connection to 127.10.189.195:40143: connect: Connection refused (error 111)
I20260806 15:56:10.548477 16069 raft_consensus.cc:504] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:10.548906 16069 leader_election.cc:288] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [CANDIDATE]: Term 4 election: Requested vote from peers dae5641066e142d084e63647b997469e (127.10.189.193:42135), 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801), e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143), 7a401814ff5840b38259456e3d52fbf9 (127.10.189.197:34483)
I20260806 15:56:10.549168 15322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "dae5641066e142d084e63647b997469e"
I20260806 15:56:10.549221 15882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6a9aa60c3ba4e29b1e4f81700986dfc" candidate_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "7a401814ff5840b38259456e3d52fbf9"
I20260806 15:56:10.549300 15322 raft_consensus.cc:3037] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 3 FOLLOWER]: Advancing to term 4
I20260806 15:56:10.549348 15882 raft_consensus.cc:3037] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 3 FOLLOWER]: Advancing to term 4
W20260806 15:56:10.549861 15389 leader_election.cc:334] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143): Network error: Client connection negotiation failed: client connection to 127.10.189.195:40143: connect: Connection refused (error 111)
W20260806 15:56:10.550257 15391 leader_election.cc:334] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801): Network error: Client connection negotiation failed: client connection to 127.10.189.196:33801: connect: Connection refused (error 111)
I20260806 15:56:10.550500 15322 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e91ee93c9a4145bea6cdd460816b0d in term 4.
I20260806 15:56:10.550577 15882 raft_consensus.cc:2454] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e91ee93c9a4145bea6cdd460816b0d in term 4.
I20260806 15:56:10.550856 15390 leader_election.cc:302] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 5 responses out of 5 voters: 3 yes votes; 2 no votes. yes voters: 7a401814ff5840b38259456e3d52fbf9, dae5641066e142d084e63647b997469e, e5e91ee93c9a4145bea6cdd460816b0d; no voters: 523e1bb9a7ce40ceace348732e6bca34, e3b3ad3178504c20bb4a2d2a71091034
I20260806 15:56:10.551017 16069 raft_consensus.cc:2781] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 4 FOLLOWER]: Leader election won for term 4
I20260806 15:56:10.551254 16069 raft_consensus.cc:686] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [term 4 LEADER]: Becoming Leader. State: Replica: e5e91ee93c9a4145bea6cdd460816b0d, State: Running, Role: LEADER
I20260806 15:56:10.551591 16069 consensus_queue.cc:237] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 2.12, Last appended by leader: 12, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:10.554211 15162 catalog_manager.cc:5495] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d reported cstate change: term changed from 2 to 4, leader changed from e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195) to e5e91ee93c9a4145bea6cdd460816b0d (127.10.189.194). New cstate: current_term: 4 leader_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20260806 15:56:10.975584 10999 raft_consensus_election-itest.cc:397] Writing data to leader of 5-node config (3 alive)...
W20260806 15:56:10.978175 15932 meta_cache.cc:302] tablet d6a9aa60c3ba4e29b1e4f81700986dfc: replica e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143) has failed: Network error: Client connection negotiation failed: client connection to 127.10.189.195:40143: connect: Connection refused (error 111)
W20260806 15:56:10.980289 15279 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:32992: Illegal state: replica dae5641066e142d084e63647b997469e is not leader of this config: current role FOLLOWER
I20260806 15:56:10.991148 15322 raft_consensus.cc:1261] T d6a9aa60c3ba4e29b1e4f81700986dfc P dae5641066e142d084e63647b997469e [term 4 FOLLOWER]: Refusing update from remote peer e5e91ee93c9a4145bea6cdd460816b0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 12. Preceding OpId from leader: term: 4 index: 14. (index mismatch)
I20260806 15:56:10.991199 15882 raft_consensus.cc:1261] T d6a9aa60c3ba4e29b1e4f81700986dfc P 7a401814ff5840b38259456e3d52fbf9 [term 4 FOLLOWER]: Refusing update from remote peer e5e91ee93c9a4145bea6cdd460816b0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 12. Preceding OpId from leader: term: 4 index: 14. (index mismatch)
I20260806 15:56:10.991834 16073 consensus_queue.cc:1035] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260806 15:56:10.992002 15389 consensus_peers.cc:487] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d -> Peer e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143): Couldn't send request to peer e3b3ad3178504c20bb4a2d2a71091034. Status: Network error: Client connection negotiation failed: client connection to 127.10.189.195:40143: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260806 15:56:10.992028 15391 consensus_peers.cc:487] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d -> Peer 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801): Couldn't send request to peer 523e1bb9a7ce40ceace348732e6bca34. Status: Network error: Client connection negotiation failed: client connection to 127.10.189.196:33801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 15:56:10.992168 16085 consensus_queue.cc:1035] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260806 15:56:11.014995 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.195:40143
--local_ip_for_outbound_sockets=127.10.189.195
--tserver_master_addrs=127.10.189.254:44073
--webserver_port=33551
--webserver_interface=127.10.189.195
--builtin_ntp_servers=127.10.189.212:41733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=50 with env {}
W20260806 15:56:11.132601 16096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:11.132951 16096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:11.133029 16096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:11.137439 16096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:11.137580 16096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.195
I20260806 15:56:11.142695 16096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:41733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=50
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.195:40143
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.189.195
--webserver_port=33551
--tserver_master_addrs=127.10.189.254:44073
--never_fsync=true
--heap_profile_path=/tmp/kudu.16096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.195
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:11.143822 16096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:11.145265 16096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:11.155364 16102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:11.155368 16104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:11.155450 16101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:11.155982 16096 server_base.cc:1034] running on GCE node
I20260806 15:56:11.156351 16096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:11.156939 16096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:11.158145 16096 hybrid_clock.cc:648] HybridClock initialized: now 1786031771158128 us; error 26 us; skew 500 ppm
I20260806 15:56:11.163543 16096 webserver.cc:460] Webserver started at http://127.10.189.195:33551/ using document root <none> and password file <none>
I20260806 15:56:11.164255 16096 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:11.164362 16096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:11.168234 16096 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 15:56:11.170442 16110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:11.171728 16096 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 15:56:11.171846 16096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "e3b3ad3178504c20bb4a2d2a71091034"
format_stamp: "Formatted at 2026-08-06 15:56:04 on dist-test-slave-mn4r"
I20260806 15:56:11.172397 16096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:11.184675 16096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:11.185302 16096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:11.185453 16096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:11.185962 16096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:11.187171 16117 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 15:56:11.190974 16096 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 15:56:11.191030 16096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260806 15:56:11.191102 16096 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 15:56:11.192633 16096 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 15:56:11.192678 16096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260806 15:56:11.193001 16117 tablet_bootstrap.cc:492] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034: Bootstrap starting.
I20260806 15:56:11.203171 16096 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.195:40143
I20260806 15:56:11.203222 16228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.195:40143 every 8 connection(s)
I20260806 15:56:11.204152 16096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260806 15:56:11.209872 16117 log.cc:824] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:11.212657 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 16096
I20260806 15:56:11.213121 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.196:33801
--local_ip_for_outbound_sockets=127.10.189.196
--tserver_master_addrs=127.10.189.254:44073
--webserver_port=38617
--webserver_interface=127.10.189.196
--builtin_ntp_servers=127.10.189.212:41733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=50 with env {}
I20260806 15:56:11.214376 16229 heartbeater.cc:347] Connected to a master server at 127.10.189.254:44073
I20260806 15:56:11.214780 16229 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:11.215476 16229 heartbeater.cc:511] Master 127.10.189.254:44073 requested a full tablet report, sending...
I20260806 15:56:11.217558 15159 ts_manager.cc:194] Re-registered known tserver with Master: e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143)
I20260806 15:56:11.218472 15159 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.195:53933
I20260806 15:56:11.229182 16117 tablet_bootstrap.cc:492] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=100 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 15:56:11.229640 16117 tablet_bootstrap.cc:492] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034: Bootstrap complete.
I20260806 15:56:11.231102 16117 ts_tablet_manager.cc:1397] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034: Time spent bootstrapping tablet: real 0.038s user 0.026s sys 0.011s
I20260806 15:56:11.234469 16117 raft_consensus.cc:348] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:11.235023 16117 raft_consensus.cc:729] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b3ad3178504c20bb4a2d2a71091034, State: Initialized, Role: FOLLOWER
I20260806 15:56:11.235536 16117 consensus_queue.cc:260] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 2.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:11.236253 16229 heartbeater.cc:503] Master 127.10.189.254:44073 was elected leader, sending a full tablet report...
I20260806 15:56:11.236641 16117 ts_tablet_manager.cc:1428] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260806 15:56:11.332566 16235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:11.332887 16235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:11.332994 16235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:11.337244 16235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:11.337387 16235 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.196
I20260806 15:56:11.342481 16235 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:41733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=50
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.196:33801
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.10.189.196
--webserver_port=38617
--tserver_master_addrs=127.10.189.254:44073
--never_fsync=true
--heap_profile_path=/tmp/kudu.16235
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.196
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:11.343616 16235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:11.345798 16235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:11.357214 16245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:11.357259 16242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:11.357264 16241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:11.357545 16235 server_base.cc:1034] running on GCE node
I20260806 15:56:11.357959 16235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:11.358642 16235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:11.359828 16235 hybrid_clock.cc:648] HybridClock initialized: now 1786031771359810 us; error 37 us; skew 500 ppm
I20260806 15:56:11.361644 16235 webserver.cc:460] Webserver started at http://127.10.189.196:38617/ using document root <none> and password file <none>
I20260806 15:56:11.362356 16235 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:11.362471 16235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:11.366310 16235 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 15:56:11.368451 16251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:11.369673 16235 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 15:56:11.369804 16235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "523e1bb9a7ce40ceace348732e6bca34"
format_stamp: "Formatted at 2026-08-06 15:56:05 on dist-test-slave-mn4r"
I20260806 15:56:11.370405 16235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:11.380520 16235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:11.381178 16235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:11.381374 16235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:11.381968 16235 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:11.383293 16258 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 15:56:11.387109 16235 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 15:56:11.387187 16235 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260806 15:56:11.387295 16235 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 15:56:11.388846 16235 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 15:56:11.388912 16235 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260806 15:56:11.389204 16258 tablet_bootstrap.cc:492] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34: Bootstrap starting.
I20260806 15:56:11.399821 16235 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.196:33801
I20260806 15:56:11.399976 16367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.196:33801 every 8 connection(s)
I20260806 15:56:11.400925 16235 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20260806 15:56:11.401182 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 16235
I20260806 15:56:11.425184 16258 log.cc:824] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:11.429596 16368 heartbeater.cc:347] Connected to a master server at 127.10.189.254:44073
I20260806 15:56:11.429883 16368 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:11.430521 16368 heartbeater.cc:511] Master 127.10.189.254:44073 requested a full tablet report, sending...
I20260806 15:56:11.432440 15159 ts_manager.cc:194] Re-registered known tserver with Master: 523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801)
I20260806 15:56:11.433283 15159 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.196:53797
I20260806 15:56:11.439782 16258 tablet_bootstrap.cc:492] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=50 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 15:56:11.440191 16258 tablet_bootstrap.cc:492] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34: Bootstrap complete.
I20260806 15:56:11.441277 16258 ts_tablet_manager.cc:1397] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34: Time spent bootstrapping tablet: real 0.052s user 0.022s sys 0.024s
I20260806 15:56:11.444707 16258 raft_consensus.cc:348] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:11.445186 16258 raft_consensus.cc:729] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523e1bb9a7ce40ceace348732e6bca34, State: Initialized, Role: FOLLOWER
I20260806 15:56:11.445714 16258 consensus_queue.cc:260] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dae5641066e142d084e63647b997469e" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 42135 } } peers { permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 } } peers { permanent_uuid: "e3b3ad3178504c20bb4a2d2a71091034" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 40143 } } peers { permanent_uuid: "e5e91ee93c9a4145bea6cdd460816b0d" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 43277 } } peers { permanent_uuid: "7a401814ff5840b38259456e3d52fbf9" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 34483 } }
I20260806 15:56:11.446539 16368 heartbeater.cc:503] Master 127.10.189.254:44073 was elected leader, sending a full tablet report...
I20260806 15:56:11.446836 16258 ts_tablet_manager.cc:1428] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34: Time spent starting tablet: real 0.005s user 0.007s sys 0.001s
I20260806 15:56:11.470769 15859 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260806 15:56:11.471855 15301 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260806 15:56:11.474300 15438 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260806 15:56:11.475251 16300 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260806 15:56:11.483599 16161 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
4ba81bb4a42c4575a61f38028abaab1e | 127.10.189.254:44073 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.189.212:41733 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
523e1bb9a7ce40ceace348732e6bca34 | 127.10.189.196:33801 | HEALTHY | <none> | 0 | 0
7a401814ff5840b38259456e3d52fbf9 | 127.10.189.197:34483 | HEALTHY | <none> | 0 | 0
dae5641066e142d084e63647b997469e | 127.10.189.193:42135 | HEALTHY | <none> | 0 | 0
e3b3ad3178504c20bb4a2d2a71091034 | 127.10.189.195:40143 | HEALTHY | <none> | 0 | 0
e5e91ee93c9a4145bea6cdd460816b0d | 127.10.189.194:43277 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 5
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 5 server(s) checked
local_ip_for_outbound_sockets | 127.10.189.193 | experimental | 127.10.189.193:42135
local_ip_for_outbound_sockets | 127.10.189.194 | experimental | 127.10.189.194:43277
local_ip_for_outbound_sockets | 127.10.189.195 | experimental | 127.10.189.195:40143
local_ip_for_outbound_sockets | 127.10.189.196 | experimental | 127.10.189.196:33801
local_ip_for_outbound_sockets | 127.10.189.197 | experimental | 127.10.189.197:34483
never_fsync | true | unsafe,advanced | all 5 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 5 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 5 server(s) checked
server_dump_info_format | pb | hidden | all 5 server(s) checked
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.10.189.193:42135
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.10.189.194:43277
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.10.189.195:40143
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data/info.pb | hidden | 127.10.189.196:33801
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/data/info.pb | hidden | 127.10.189.197:34483
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.189.212:41733 | all 5 server(s) checked
time_source | builtin | all 5 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 6 server(s) checked
Tablet Summary
Tablet d6a9aa60c3ba4e29b1e4f81700986dfc of table 'TestTable' is conflicted: 2 replicas' active configs disagree with the leader master's
dae5641066e142d084e63647b997469e (127.10.189.193:42135): RUNNING
523e1bb9a7ce40ceace348732e6bca34 (127.10.189.196:33801): RUNNING
e3b3ad3178504c20bb4a2d2a71091034 (127.10.189.195:40143): RUNNING
e5e91ee93c9a4145bea6cdd460816b0d (127.10.189.194:43277): RUNNING [LEADER]
7a401814ff5840b38259456e3d52fbf9 (127.10.189.197:34483): RUNNING
All reported replicas are:
A = dae5641066e142d084e63647b997469e
B = 523e1bb9a7ce40ceace348732e6bca34
C = e3b3ad3178504c20bb4a2d2a71091034
D = e5e91ee93c9a4145bea6cdd460816b0d
E = 7a401814ff5840b38259456e3d52fbf9
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+----------------------+--------------+--------------+------------
master | A B C D* E | | | Yes
A | A B C D* E | 4 | -1 | Yes
B | A B C D E | 1 | -1 | Yes
C | A B C D E | 2 | -1 | Yes
D | A B C D* E | 4 | -1 | Yes
E | A B C D* E | 4 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-----------+----+--------------------+---------------+---------+------------+------------------+-------------
TestTable | 5 | CONSENSUS_MISMATCH | 1 | 0 | 0 | 0 | 1
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 5
Tables | 1
Tablets | 1
Replicas | 5
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260806 15:56:11.508949 10999 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260806 15:56:11.565106 16182 raft_consensus.cc:3037] T d6a9aa60c3ba4e29b1e4f81700986dfc P e3b3ad3178504c20bb4a2d2a71091034 [term 2 FOLLOWER]: Advancing to term 4
I20260806 15:56:11.565244 16320 raft_consensus.cc:3037] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [term 1 FOLLOWER]: Advancing to term 4
I20260806 15:56:11.568058 16320 raft_consensus.cc:1261] T d6a9aa60c3ba4e29b1e4f81700986dfc P 523e1bb9a7ce40ceace348732e6bca34 [term 4 FOLLOWER]: Refusing update from remote peer e5e91ee93c9a4145bea6cdd460816b0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
I20260806 15:56:11.568780 16084 consensus_queue.cc:1037] T d6a9aa60c3ba4e29b1e4f81700986dfc P e5e91ee93c9a4145bea6cdd460816b0d [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "523e1bb9a7ce40ceace348732e6bca34" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 6, Time since last communication: 0.000s
I20260806 15:56:11.570709 16407 mvcc.cc:205] Tried to move back new op lower bound from 7315586134030381056 to 7315586132182261760. Current Snapshot: MvccSnapshot[applied={T|T < 7315586133974241280}]
I20260806 15:56:11.578118 16413 mvcc.cc:205] Tried to move back new op lower bound from 7315586134064312320 to 7315586118548226048. Current Snapshot: MvccSnapshot[applied={T|T < 7315586134046978048}]
I20260806 15:56:11.712769 16300 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260806 15:56:11.714041 15438 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260806 15:56:11.714066 15859 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260806 15:56:11.714525 16161 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260806 15:56:11.724743 15301 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
4ba81bb4a42c4575a61f38028abaab1e | 127.10.189.254:44073 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.189.212:41733 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
523e1bb9a7ce40ceace348732e6bca34 | 127.10.189.196:33801 | HEALTHY | <none> | 0 | 0
7a401814ff5840b38259456e3d52fbf9 | 127.10.189.197:34483 | HEALTHY | <none> | 0 | 0
dae5641066e142d084e63647b997469e | 127.10.189.193:42135 | HEALTHY | <none> | 0 | 0
e3b3ad3178504c20bb4a2d2a71091034 | 127.10.189.195:40143 | HEALTHY | <none> | 0 | 0
e5e91ee93c9a4145bea6cdd460816b0d | 127.10.189.194:43277 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 5
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 5 server(s) checked
local_ip_for_outbound_sockets | 127.10.189.193 | experimental | 127.10.189.193:42135
local_ip_for_outbound_sockets | 127.10.189.194 | experimental | 127.10.189.194:43277
local_ip_for_outbound_sockets | 127.10.189.195 | experimental | 127.10.189.195:40143
local_ip_for_outbound_sockets | 127.10.189.196 | experimental | 127.10.189.196:33801
local_ip_for_outbound_sockets | 127.10.189.197 | experimental | 127.10.189.197:34483
never_fsync | true | unsafe,advanced | all 5 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 5 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 5 server(s) checked
server_dump_info_format | pb | hidden | all 5 server(s) checked
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.10.189.193:42135
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.10.189.194:43277
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.10.189.195:40143
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data/info.pb | hidden | 127.10.189.196:33801
server_dump_info_path | /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/data/info.pb | hidden | 127.10.189.197:34483
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.189.212:41733 | all 5 server(s) checked
time_source | builtin | all 5 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 6 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-----------+----+---------+---------------+---------+------------+------------------+-------------
TestTable | 5 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 5
Tables | 1
Tablets | 1
Replicas | 5
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260806 15:56:11.754235 10999 log_verifier.cc:126] Checking tablet d6a9aa60c3ba4e29b1e4f81700986dfc
I20260806 15:56:11.860702 10999 log_verifier.cc:177] Verified matching terms for 18 ops in tablet d6a9aa60c3ba4e29b1e4f81700986dfc
I20260806 15:56:12.099262 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 15228
I20260806 15:56:12.107894 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 15373
I20260806 15:56:12.115175 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 16096
I20260806 15:56:12.122617 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 16235
I20260806 15:56:12.129025 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 15797
I20260806 15:56:12.135269 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 15131
2026-08-06T15:56:12Z chronyd exiting
[ OK ] RaftConsensusElectionITest.AutomaticLeaderElection (7926 ms)
[ RUN ] RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica
I20260806 15:56:12.163439 10999 test_util.cc:268] Using random seed: -313107096
I20260806 15:56:12.164218 10999 ts_itest-base.cc:112] Starting cluster with:
I20260806 15:56:12.164268 10999 ts_itest-base.cc:113] --------------
I20260806 15:56:12.164278 10999 ts_itest-base.cc:114] 1 tablet servers
I20260806 15:56:12.164288 10999 ts_itest-base.cc:115] 1 replicas per TS
I20260806 15:56:12.164299 10999 ts_itest-base.cc:116] --------------
2026-08-06T15:56:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:56:12Z Disabled control of system clock
I20260806 15:56:12.173512 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:38155
--webserver_interface=127.10.189.254
--webserver_port=0
--builtin_ntp_servers=127.10.189.212:40289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.189.254:38155 with env {}
W20260806 15:56:12.282522 16460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:12.282809 16460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:12.282878 16460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:12.286847 16460 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:56:12.286927 16460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:12.286962 16460 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:56:12.287019 16460 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:56:12.291695 16460 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:40289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.189.254:38155
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:38155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.10.189.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.16460
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:12.292773 16460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:12.294209 16460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 15:56:12.302511 16460 server_base.cc:1034] running on GCE node
W20260806 15:56:12.302553 16465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:12.302507 16466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:12.302695 16468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:12.303383 16460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:12.304468 16460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:12.305672 16460 hybrid_clock.cc:648] HybridClock initialized: now 1786031772305643 us; error 38 us; skew 500 ppm
I20260806 15:56:12.307677 16460 webserver.cc:460] Webserver started at http://127.10.189.254:44605/ using document root <none> and password file <none>
I20260806 15:56:12.308257 16460 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:12.308351 16460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:12.308588 16460 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:12.310527 16460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "d6fd68257cd9488d9818339e01a293b0"
format_stamp: "Formatted at 2026-08-06 15:56:12 on dist-test-slave-mn4r"
I20260806 15:56:12.311094 16460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "d6fd68257cd9488d9818339e01a293b0"
format_stamp: "Formatted at 2026-08-06 15:56:12 on dist-test-slave-mn4r"
I20260806 15:56:12.314631 16460 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260806 15:56:12.316849 16475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:12.318053 16460 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 15:56:12.318243 16460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
uuid: "d6fd68257cd9488d9818339e01a293b0"
format_stamp: "Formatted at 2026-08-06 15:56:12 on dist-test-slave-mn4r"
I20260806 15:56:12.318346 16460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:12.333051 16460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:12.333688 16460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:12.333897 16460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:12.340898 16460 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.254:38155
I20260806 15:56:12.340914 16530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.254:38155 every 8 connection(s)
I20260806 15:56:12.341795 16460 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260806 15:56:12.345103 16531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:12.349116 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 16460
I20260806 15:56:12.349251 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260806 15:56:12.350370 16531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0: Bootstrap starting.
I20260806 15:56:12.353056 16531 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:12.353935 16531 log.cc:824] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:12.355904 16531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0: No bootstrap required, opened a new log
I20260806 15:56:12.360458 16531 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6fd68257cd9488d9818339e01a293b0" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 38155 } }
I20260806 15:56:12.360707 16531 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:56:12.360783 16531 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6fd68257cd9488d9818339e01a293b0, State: Initialized, Role: FOLLOWER
I20260806 15:56:12.361227 16531 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6fd68257cd9488d9818339e01a293b0" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 38155 } }
I20260806 15:56:12.361390 16531 raft_consensus.cc:388] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:56:12.361481 16531 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:56:12.361588 16531 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:12.362568 16531 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6fd68257cd9488d9818339e01a293b0" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 38155 } }
I20260806 15:56:12.362917 16531 leader_election.cc:302] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d6fd68257cd9488d9818339e01a293b0; no voters:
I20260806 15:56:12.363220 16531 leader_election.cc:288] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:56:12.363346 16536 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:12.363585 16536 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0 [term 1 LEADER]: Becoming Leader. State: Replica: d6fd68257cd9488d9818339e01a293b0, State: Running, Role: LEADER
I20260806 15:56:12.363940 16536 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6fd68257cd9488d9818339e01a293b0" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 38155 } }
I20260806 15:56:12.364509 16531 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:56:12.365672 16538 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6fd68257cd9488d9818339e01a293b0. Latest consensus state: current_term: 1 leader_uuid: "d6fd68257cd9488d9818339e01a293b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6fd68257cd9488d9818339e01a293b0" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 38155 } } }
I20260806 15:56:12.365800 16538 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0 [sys.catalog]: This master's current role is: LEADER
I20260806 15:56:12.366109 16537 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d6fd68257cd9488d9818339e01a293b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6fd68257cd9488d9818339e01a293b0" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 38155 } } }
I20260806 15:56:12.366202 16537 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0 [sys.catalog]: This master's current role is: LEADER
I20260806 15:56:12.366232 16545 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:56:12.368983 16545 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:56:12.374229 16545 catalog_manager.cc:1347] Generated new cluster ID: c5e952d5f9a040e1b9d266a046b5d9b2
I20260806 15:56:12.374301 16545 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:56:12.392231 16545 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:56:12.393447 16545 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:56:12.406840 16545 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6fd68257cd9488d9818339e01a293b0: Generated new TSK 0
I20260806 15:56:12.407707 16545 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:56:12.418648 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.193:0
--local_ip_for_outbound_sockets=127.10.189.193
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:38155
--builtin_ntp_servers=127.10.189.212:40289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=50 with env {}
W20260806 15:56:12.533880 16557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:12.534190 16557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:12.534252 16557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:12.538278 16557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:12.538419 16557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.193
I20260806 15:56:12.543085 16557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:40289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=50
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:38155
--never_fsync=true
--heap_profile_path=/tmp/kudu.16557
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.193
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:12.544174 16557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:12.545580 16557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:12.554893 16565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:12.554904 16562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:12.554948 16563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:12.555315 16557 server_base.cc:1034] running on GCE node
I20260806 15:56:12.555713 16557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:12.556315 16557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:12.557502 16557 hybrid_clock.cc:648] HybridClock initialized: now 1786031772557486 us; error 24 us; skew 500 ppm
I20260806 15:56:12.559370 16557 webserver.cc:460] Webserver started at http://127.10.189.193:42811/ using document root <none> and password file <none>
I20260806 15:56:12.559950 16557 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:12.560050 16557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:12.560281 16557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:12.562239 16557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "bf46406873e4470b9551ab8cd90dcb22"
format_stamp: "Formatted at 2026-08-06 15:56:12 on dist-test-slave-mn4r"
I20260806 15:56:12.562808 16557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "bf46406873e4470b9551ab8cd90dcb22"
format_stamp: "Formatted at 2026-08-06 15:56:12 on dist-test-slave-mn4r"
I20260806 15:56:12.567055 16557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 15:56:12.569506 16571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:12.570804 16557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 15:56:12.570938 16557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "bf46406873e4470b9551ab8cd90dcb22"
format_stamp: "Formatted at 2026-08-06 15:56:12 on dist-test-slave-mn4r"
I20260806 15:56:12.571053 16557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:12.598948 16557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:12.599671 16557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:12.599876 16557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:12.600495 16557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:12.601492 16557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:12.601573 16557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:12.601665 16557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:12.601712 16557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:12.610950 16557 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.193:46157
I20260806 15:56:12.610975 16687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.193:46157 every 8 connection(s)
I20260806 15:56:12.611871 16557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260806 15:56:12.615942 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 16557
I20260806 15:56:12.616071 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260806 15:56:12.622157 16688 heartbeater.cc:347] Connected to a master server at 127.10.189.254:38155
I20260806 15:56:12.622402 16688 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:12.622887 16688 heartbeater.cc:511] Master 127.10.189.254:38155 requested a full tablet report, sending...
I20260806 15:56:12.624274 16492 ts_manager.cc:194] Registered new tserver with Master: bf46406873e4470b9551ab8cd90dcb22 (127.10.189.193:46157)
I20260806 15:56:12.625427 16492 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.193:48717
I20260806 15:56:12.629925 10999 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20260806 15:56:12.638779 16492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58220:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20260806 15:56:12.656143 16619 tablet_service.cc:1467] Processing CreateTablet for tablet d6a150cf271746c79753d5eeb52b3954 (DEFAULT_TABLE table=TestTable [id=381b26460f8345c39ba5c2e9bb8099c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:12.657111 16619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6a150cf271746c79753d5eeb52b3954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:12.662926 16698 tablet_bootstrap.cc:492] T d6a150cf271746c79753d5eeb52b3954 P bf46406873e4470b9551ab8cd90dcb22: Bootstrap starting.
I20260806 15:56:12.665796 16698 tablet_bootstrap.cc:654] T d6a150cf271746c79753d5eeb52b3954 P bf46406873e4470b9551ab8cd90dcb22: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:12.666673 16698 log.cc:824] T d6a150cf271746c79753d5eeb52b3954 P bf46406873e4470b9551ab8cd90dcb22: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:12.668430 16698 tablet_bootstrap.cc:492] T d6a150cf271746c79753d5eeb52b3954 P bf46406873e4470b9551ab8cd90dcb22: No bootstrap required, opened a new log
I20260806 15:56:12.668637 16698 ts_tablet_manager.cc:1397] T d6a150cf271746c79753d5eeb52b3954 P bf46406873e4470b9551ab8cd90dcb22: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260806 15:56:12.672369 16698 raft_consensus.cc:348] T d6a150cf271746c79753d5eeb52b3954 P bf46406873e4470b9551ab8cd90dcb22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf46406873e4470b9551ab8cd90dcb22" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 46157 } }
I20260806 15:56:12.672626 16698 raft_consensus.cc:374] T d6a150cf271746c79753d5eeb52b3954 P bf46406873e4470b9551ab8cd90dcb22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:56:12.672688 16698 raft_consensus.cc:729] T d6a150cf271746c79753d5eeb52b3954 P bf46406873e4470b9551ab8cd90dcb22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf46406873e4470b9551ab8cd90dcb22, State: Initialized, Role: FOLLOWER
I20260806 15:56:12.673116 16698 consensus_queue.cc:260] T d6a150cf271746c79753d5eeb52b3954 P bf46406873e4470b9551ab8cd90dcb22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf46406873e4470b9551ab8cd90dcb22" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 46157 } }
I20260806 15:56:12.673269 16698 raft_consensus.cc:388] T d6a150cf271746c79753d5eeb52b3954 P bf46406873e4470b9551ab8cd90dcb22 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:56:12.673338 16698 raft_consensus.cc:482] T d6a150cf271746c79753d5eeb52b3954 P bf46406873e4470b9551ab8cd90dcb22 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:56:12.673437 16698 raft_consensus.cc:3037] T d6a150cf271746c79753d5eeb52b3954 P bf46406873e4470b9551ab8cd90dcb22 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:12.674448 16698 raft_consensus.cc:504] T d6a150cf271746c79753d5eeb52b3954 P bf46406873e4470b9551ab8cd90dcb22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf46406873e4470b9551ab8cd90dcb22" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 46157 } }
I20260806 15:56:12.674862 16698 leader_election.cc:302] T d6a150cf271746c79753d5eeb52b3954 P bf46406873e4470b9551ab8cd90dcb22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf46406873e4470b9551ab8cd90dcb22; no voters:
I20260806 15:56:12.675238 16698 leader_election.cc:288] T d6a150cf271746c79753d5eeb52b3954 P bf46406873e4470b9551ab8cd90dcb22 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:56:12.675455 16700 raft_consensus.cc:2781] T d6a150cf271746c79753d5eeb52b3954 P bf46406873e4470b9551ab8cd90dcb22 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:12.675804 16700 raft_consensus.cc:686] T d6a150cf271746c79753d5eeb52b3954 P bf46406873e4470b9551ab8cd90dcb22 [term 1 LEADER]: Becoming Leader. State: Replica: bf46406873e4470b9551ab8cd90dcb22, State: Running, Role: LEADER
I20260806 15:56:12.675946 16688 heartbeater.cc:503] Master 127.10.189.254:38155 was elected leader, sending a full tablet report...
I20260806 15:56:12.676303 16700 consensus_queue.cc:237] T d6a150cf271746c79753d5eeb52b3954 P bf46406873e4470b9551ab8cd90dcb22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf46406873e4470b9551ab8cd90dcb22" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 46157 } }
I20260806 15:56:12.676340 16698 ts_tablet_manager.cc:1428] T d6a150cf271746c79753d5eeb52b3954 P bf46406873e4470b9551ab8cd90dcb22: Time spent starting tablet: real 0.008s user 0.006s sys 0.002s
I20260806 15:56:12.680231 16492 catalog_manager.cc:5495] T d6a150cf271746c79753d5eeb52b3954 P bf46406873e4470b9551ab8cd90dcb22 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf46406873e4470b9551ab8cd90dcb22 (127.10.189.193). New cstate: current_term: 1 leader_uuid: "bf46406873e4470b9551ab8cd90dcb22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf46406873e4470b9551ab8cd90dcb22" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 46157 } health_report { overall_health: HEALTHY } } }
I20260806 15:56:12.689878 10999 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20260806 15:56:12.691265 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver bf46406873e4470b9551ab8cd90dcb22 to finish bootstrapping
I20260806 15:56:12.702405 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 16557
I20260806 15:56:12.710265 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 16460
2026-08-06T15:56:12Z chronyd exiting
[ OK ] RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica (567 ms)
[ RUN ] RaftConsensusElectionITest.LeaderStepDown
I20260806 15:56:12.731091 10999 test_util.cc:268] Using random seed: -312539442
I20260806 15:56:12.731899 10999 ts_itest-base.cc:112] Starting cluster with:
I20260806 15:56:12.731945 10999 ts_itest-base.cc:113] --------------
I20260806 15:56:12.731956 10999 ts_itest-base.cc:114] 3 tablet servers
I20260806 15:56:12.731967 10999 ts_itest-base.cc:115] 3 replicas per TS
I20260806 15:56:12.732004 10999 ts_itest-base.cc:116] --------------
2026-08-06T15:56:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:56:12Z Disabled control of system clock
I20260806 15:56:12.741258 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:42417
--webserver_interface=127.10.189.254
--webserver_port=0
--builtin_ntp_servers=127.10.189.212:45659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.189.254:42417
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260806 15:56:12.850129 16714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:12.850414 16714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:12.850479 16714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:12.854444 16714 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:56:12.854521 16714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:12.854563 16714 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:56:12.854619 16714 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:56:12.859246 16714 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:45659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.10.189.254:42417
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:42417
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.10.189.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.16714
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:12.860351 16714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:12.861765 16714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:12.870525 16719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:12.870565 16722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:12.870599 16720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:12.870738 16714 server_base.cc:1034] running on GCE node
I20260806 15:56:12.871498 16714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:12.872651 16714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:12.873842 16714 hybrid_clock.cc:648] HybridClock initialized: now 1786031772873824 us; error 34 us; skew 500 ppm
I20260806 15:56:12.875936 16714 webserver.cc:460] Webserver started at http://127.10.189.254:45691/ using document root <none> and password file <none>
I20260806 15:56:12.876709 16714 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:12.876778 16714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:12.876958 16714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:12.878945 16714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "9e8a901c7af7445697bb48e7a8cae46e"
format_stamp: "Formatted at 2026-08-06 15:56:12 on dist-test-slave-mn4r"
I20260806 15:56:12.879467 16714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "9e8a901c7af7445697bb48e7a8cae46e"
format_stamp: "Formatted at 2026-08-06 15:56:12 on dist-test-slave-mn4r"
I20260806 15:56:12.883213 16714 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260806 15:56:12.885718 16728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:12.887212 16714 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 15:56:12.887326 16714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
uuid: "9e8a901c7af7445697bb48e7a8cae46e"
format_stamp: "Formatted at 2026-08-06 15:56:12 on dist-test-slave-mn4r"
I20260806 15:56:12.887418 16714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:12.916345 16714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:12.917152 16714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:12.917316 16714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:12.924818 16714 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.254:42417
I20260806 15:56:12.924839 16782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.254:42417 every 8 connection(s)
I20260806 15:56:12.925793 16714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260806 15:56:12.927013 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 16714
I20260806 15:56:12.927155 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260806 15:56:12.929479 16783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:12.935128 16783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e: Bootstrap starting.
I20260806 15:56:12.937660 16783 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:12.938513 16783 log.cc:824] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:12.940300 16783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e: No bootstrap required, opened a new log
I20260806 15:56:12.943961 16783 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e8a901c7af7445697bb48e7a8cae46e" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42417 } }
I20260806 15:56:12.944182 16783 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:56:12.944244 16783 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8a901c7af7445697bb48e7a8cae46e, State: Initialized, Role: FOLLOWER
I20260806 15:56:12.944658 16783 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e8a901c7af7445697bb48e7a8cae46e" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42417 } }
I20260806 15:56:12.944777 16783 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:56:12.944844 16783 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:56:12.944945 16783 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:12.945816 16783 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e8a901c7af7445697bb48e7a8cae46e" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42417 } }
I20260806 15:56:12.946208 16783 leader_election.cc:302] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9e8a901c7af7445697bb48e7a8cae46e; no voters:
I20260806 15:56:12.946529 16783 leader_election.cc:288] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:56:12.946660 16789 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:12.946918 16789 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e [term 1 LEADER]: Becoming Leader. State: Replica: 9e8a901c7af7445697bb48e7a8cae46e, State: Running, Role: LEADER
I20260806 15:56:12.947228 16789 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e8a901c7af7445697bb48e7a8cae46e" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42417 } }
I20260806 15:56:12.947849 16783 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:56:12.948979 16790 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9e8a901c7af7445697bb48e7a8cae46e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e8a901c7af7445697bb48e7a8cae46e" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42417 } } }
I20260806 15:56:12.949137 16790 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e [sys.catalog]: This master's current role is: LEADER
I20260806 15:56:12.948979 16791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e8a901c7af7445697bb48e7a8cae46e. Latest consensus state: current_term: 1 leader_uuid: "9e8a901c7af7445697bb48e7a8cae46e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e8a901c7af7445697bb48e7a8cae46e" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42417 } } }
I20260806 15:56:12.949396 16791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e [sys.catalog]: This master's current role is: LEADER
I20260806 15:56:12.949561 16798 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:56:12.952280 16798 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:56:12.957644 16798 catalog_manager.cc:1347] Generated new cluster ID: 066c1afd6cd7416b9f12c680609281ac
I20260806 15:56:12.957716 16798 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:56:12.974634 16798 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:56:12.975637 16798 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:56:12.986035 16798 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9e8a901c7af7445697bb48e7a8cae46e: Generated new TSK 0
I20260806 15:56:12.986766 16798 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:56:12.995435 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.193:0
--local_ip_for_outbound_sockets=127.10.189.193
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42417
--builtin_ntp_servers=127.10.189.212:45659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260806 15:56:13.108223 16809 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:56:13.108495 16809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:13.108516 16809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:13.108594 16809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:13.112767 16809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:13.112870 16809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.193
I20260806 15:56:13.117722 16809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:45659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42417
--never_fsync=true
--heap_profile_path=/tmp/kudu.16809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.193
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:13.118887 16809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:13.120294 16809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:13.130311 16817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:13.130277 16809 server_base.cc:1034] running on GCE node
W20260806 15:56:13.130280 16814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:13.130268 16815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:13.130961 16809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:13.131665 16809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:13.132844 16809 hybrid_clock.cc:648] HybridClock initialized: now 1786031773132804 us; error 57 us; skew 500 ppm
I20260806 15:56:13.134783 16809 webserver.cc:460] Webserver started at http://127.10.189.193:36761/ using document root <none> and password file <none>
I20260806 15:56:13.135569 16809 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:13.135670 16809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:13.135932 16809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:13.137920 16809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "c41923657c0f43d2a65187483ef21dcf"
format_stamp: "Formatted at 2026-08-06 15:56:13 on dist-test-slave-mn4r"
I20260806 15:56:13.138540 16809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "c41923657c0f43d2a65187483ef21dcf"
format_stamp: "Formatted at 2026-08-06 15:56:13 on dist-test-slave-mn4r"
I20260806 15:56:13.142230 16809 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260806 15:56:13.144717 16823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:13.145926 16809 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 15:56:13.146072 16809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "c41923657c0f43d2a65187483ef21dcf"
format_stamp: "Formatted at 2026-08-06 15:56:13 on dist-test-slave-mn4r"
I20260806 15:56:13.146234 16809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:13.166755 16809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:13.167514 16809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:13.167724 16809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:13.168362 16809 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:13.169353 16809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:13.169426 16809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:13.169500 16809 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:13.169543 16809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:13.178702 16809 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.193:44553
I20260806 15:56:13.178731 16942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.193:44553 every 8 connection(s)
I20260806 15:56:13.179644 16809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260806 15:56:13.182509 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 16809
I20260806 15:56:13.182677 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260806 15:56:13.185165 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.194:0
--local_ip_for_outbound_sockets=127.10.189.194
--webserver_interface=127.10.189.194
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42417
--builtin_ntp_servers=127.10.189.212:45659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260806 15:56:13.191154 16943 heartbeater.cc:347] Connected to a master server at 127.10.189.254:42417
I20260806 15:56:13.191464 16943 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:13.192267 16943 heartbeater.cc:511] Master 127.10.189.254:42417 requested a full tablet report, sending...
I20260806 15:56:13.194053 16745 ts_manager.cc:194] Registered new tserver with Master: c41923657c0f43d2a65187483ef21dcf (127.10.189.193:44553)
I20260806 15:56:13.195326 16745 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.193:44157
W20260806 15:56:13.302963 16946 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:56:13.303233 16946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:13.303253 16946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:13.303339 16946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:13.307439 16946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:13.307535 16946 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.194
I20260806 15:56:13.312188 16946 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:45659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.10.189.194
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42417
--never_fsync=true
--heap_profile_path=/tmp/kudu.16946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.194
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:13.313314 16946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:13.314831 16946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:13.324753 16952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:13.324826 16946 server_base.cc:1034] running on GCE node
W20260806 15:56:13.324784 16955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:13.325070 16953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:13.325521 16946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:13.326239 16946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:13.327426 16946 hybrid_clock.cc:648] HybridClock initialized: now 1786031773327407 us; error 37 us; skew 500 ppm
I20260806 15:56:13.329337 16946 webserver.cc:460] Webserver started at http://127.10.189.194:40027/ using document root <none> and password file <none>
I20260806 15:56:13.329977 16946 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:13.330071 16946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:13.330327 16946 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:13.332438 16946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "5c8684cdc04f499b824ffca3b52c7e6e"
format_stamp: "Formatted at 2026-08-06 15:56:13 on dist-test-slave-mn4r"
I20260806 15:56:13.333007 16946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "5c8684cdc04f499b824ffca3b52c7e6e"
format_stamp: "Formatted at 2026-08-06 15:56:13 on dist-test-slave-mn4r"
I20260806 15:56:13.336731 16946 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260806 15:56:13.339290 16961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:13.340534 16946 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 15:56:13.340684 16946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "5c8684cdc04f499b824ffca3b52c7e6e"
format_stamp: "Formatted at 2026-08-06 15:56:13 on dist-test-slave-mn4r"
I20260806 15:56:13.340795 16946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:13.360208 16946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:13.360939 16946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:13.361146 16946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:13.361759 16946 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:13.362830 16946 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:13.362901 16946 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:13.362975 16946 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:13.363025 16946 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:13.371987 16946 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.194:36709
I20260806 15:56:13.372010 17077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.194:36709 every 8 connection(s)
I20260806 15:56:13.372915 16946 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260806 15:56:13.382936 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 16946
I20260806 15:56:13.383087 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260806 15:56:13.383466 17078 heartbeater.cc:347] Connected to a master server at 127.10.189.254:42417
I20260806 15:56:13.383704 17078 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:13.384356 17078 heartbeater.cc:511] Master 127.10.189.254:42417 requested a full tablet report, sending...
I20260806 15:56:13.385406 16745 ts_manager.cc:194] Registered new tserver with Master: 5c8684cdc04f499b824ffca3b52c7e6e (127.10.189.194:36709)
I20260806 15:56:13.385603 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.195:0
--local_ip_for_outbound_sockets=127.10.189.195
--webserver_interface=127.10.189.195
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42417
--builtin_ntp_servers=127.10.189.212:45659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260806 15:56:13.386054 16745 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.194:57213
W20260806 15:56:13.499477 17081 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:56:13.499782 17081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:13.499804 17081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:13.499867 17081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:13.504047 17081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:13.504144 17081 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.195
I20260806 15:56:13.508919 17081 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:45659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.189.195
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42417
--never_fsync=true
--heap_profile_path=/tmp/kudu.17081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.195
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:13.510069 17081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:13.511678 17081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:13.521695 17086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:13.521688 17089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:13.521688 17087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:13.522132 17081 server_base.cc:1034] running on GCE node
I20260806 15:56:13.522562 17081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:13.523273 17081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:13.524480 17081 hybrid_clock.cc:648] HybridClock initialized: now 1786031773524465 us; error 33 us; skew 500 ppm
I20260806 15:56:13.526580 17081 webserver.cc:460] Webserver started at http://127.10.189.195:40029/ using document root <none> and password file <none>
I20260806 15:56:13.527232 17081 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:13.527297 17081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:13.527479 17081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:13.529387 17081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "80b918a043c349ffbf6def634a4ea209"
format_stamp: "Formatted at 2026-08-06 15:56:13 on dist-test-slave-mn4r"
I20260806 15:56:13.529902 17081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "80b918a043c349ffbf6def634a4ea209"
format_stamp: "Formatted at 2026-08-06 15:56:13 on dist-test-slave-mn4r"
I20260806 15:56:13.533882 17081 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 15:56:13.536536 17095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:13.537853 17081 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 15:56:13.537962 17081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "80b918a043c349ffbf6def634a4ea209"
format_stamp: "Formatted at 2026-08-06 15:56:13 on dist-test-slave-mn4r"
I20260806 15:56:13.538164 17081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:13.553643 17081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:13.554416 17081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:13.554623 17081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:13.555222 17081 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:13.556192 17081 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:13.556239 17081 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:13.556310 17081 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:13.556350 17081 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:13.565317 17081 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.195:34135
I20260806 15:56:13.565344 17212 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.195:34135 every 8 connection(s)
I20260806 15:56:13.566282 17081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260806 15:56:13.572321 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 17081
I20260806 15:56:13.572443 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260806 15:56:13.577210 17213 heartbeater.cc:347] Connected to a master server at 127.10.189.254:42417
I20260806 15:56:13.577471 17213 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:13.578128 17213 heartbeater.cc:511] Master 127.10.189.254:42417 requested a full tablet report, sending...
I20260806 15:56:13.579185 16745 ts_manager.cc:194] Registered new tserver with Master: 80b918a043c349ffbf6def634a4ea209 (127.10.189.195:34135)
I20260806 15:56:13.579738 16745 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.195:48967
I20260806 15:56:13.586759 10999 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:56:13.596442 16745 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49216:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
W20260806 15:56:13.599540 16745 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:56:13.617430 17009 tablet_service.cc:1467] Processing CreateTablet for tablet d915234a98484e73b7f81e60f4a3c523 (DEFAULT_TABLE table=TestTable [id=9ff26bc3dcdf488e9d9eca55b4fe47fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:13.617596 16873 tablet_service.cc:1467] Processing CreateTablet for tablet d915234a98484e73b7f81e60f4a3c523 (DEFAULT_TABLE table=TestTable [id=9ff26bc3dcdf488e9d9eca55b4fe47fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:13.617597 17144 tablet_service.cc:1467] Processing CreateTablet for tablet d915234a98484e73b7f81e60f4a3c523 (DEFAULT_TABLE table=TestTable [id=9ff26bc3dcdf488e9d9eca55b4fe47fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:13.618451 17009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d915234a98484e73b7f81e60f4a3c523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:13.618609 17144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d915234a98484e73b7f81e60f4a3c523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:13.618609 16873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d915234a98484e73b7f81e60f4a3c523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:13.624873 17230 tablet_bootstrap.cc:492] T d915234a98484e73b7f81e60f4a3c523 P 5c8684cdc04f499b824ffca3b52c7e6e: Bootstrap starting.
I20260806 15:56:13.625452 17232 tablet_bootstrap.cc:492] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209: Bootstrap starting.
I20260806 15:56:13.625808 17231 tablet_bootstrap.cc:492] T d915234a98484e73b7f81e60f4a3c523 P c41923657c0f43d2a65187483ef21dcf: Bootstrap starting.
I20260806 15:56:13.627308 17230 tablet_bootstrap.cc:654] T d915234a98484e73b7f81e60f4a3c523 P 5c8684cdc04f499b824ffca3b52c7e6e: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:13.627415 17232 tablet_bootstrap.cc:654] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:13.627562 17231 tablet_bootstrap.cc:654] T d915234a98484e73b7f81e60f4a3c523 P c41923657c0f43d2a65187483ef21dcf: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:13.628193 17231 log.cc:824] T d915234a98484e73b7f81e60f4a3c523 P c41923657c0f43d2a65187483ef21dcf: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:13.628190 17230 log.cc:824] T d915234a98484e73b7f81e60f4a3c523 P 5c8684cdc04f499b824ffca3b52c7e6e: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:13.628190 17232 log.cc:824] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:13.629936 17231 tablet_bootstrap.cc:492] T d915234a98484e73b7f81e60f4a3c523 P c41923657c0f43d2a65187483ef21dcf: No bootstrap required, opened a new log
I20260806 15:56:13.629958 17232 tablet_bootstrap.cc:492] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209: No bootstrap required, opened a new log
I20260806 15:56:13.630143 17231 ts_tablet_manager.cc:1397] T d915234a98484e73b7f81e60f4a3c523 P c41923657c0f43d2a65187483ef21dcf: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20260806 15:56:13.630167 17232 ts_tablet_manager.cc:1397] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260806 15:56:13.630820 17230 tablet_bootstrap.cc:492] T d915234a98484e73b7f81e60f4a3c523 P 5c8684cdc04f499b824ffca3b52c7e6e: No bootstrap required, opened a new log
I20260806 15:56:13.630981 17230 ts_tablet_manager.cc:1397] T d915234a98484e73b7f81e60f4a3c523 P 5c8684cdc04f499b824ffca3b52c7e6e: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 15:56:13.633764 17231 raft_consensus.cc:348] T d915234a98484e73b7f81e60f4a3c523 P c41923657c0f43d2a65187483ef21dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80b918a043c349ffbf6def634a4ea209" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 34135 } } peers { permanent_uuid: "5c8684cdc04f499b824ffca3b52c7e6e" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 36709 } } peers { permanent_uuid: "c41923657c0f43d2a65187483ef21dcf" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 44553 } }
I20260806 15:56:13.634006 17231 raft_consensus.cc:729] T d915234a98484e73b7f81e60f4a3c523 P c41923657c0f43d2a65187483ef21dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41923657c0f43d2a65187483ef21dcf, State: Initialized, Role: FOLLOWER
I20260806 15:56:13.634310 17231 consensus_queue.cc:260] T d915234a98484e73b7f81e60f4a3c523 P c41923657c0f43d2a65187483ef21dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80b918a043c349ffbf6def634a4ea209" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 34135 } } peers { permanent_uuid: "5c8684cdc04f499b824ffca3b52c7e6e" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 36709 } } peers { permanent_uuid: "c41923657c0f43d2a65187483ef21dcf" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 44553 } }
I20260806 15:56:13.634656 17232 raft_consensus.cc:348] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80b918a043c349ffbf6def634a4ea209" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 34135 } } peers { permanent_uuid: "5c8684cdc04f499b824ffca3b52c7e6e" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 36709 } } peers { permanent_uuid: "c41923657c0f43d2a65187483ef21dcf" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 44553 } }
I20260806 15:56:13.634909 17232 raft_consensus.cc:729] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80b918a043c349ffbf6def634a4ea209, State: Initialized, Role: FOLLOWER
I20260806 15:56:13.634994 16943 heartbeater.cc:503] Master 127.10.189.254:42417 was elected leader, sending a full tablet report...
I20260806 15:56:13.635226 17232 consensus_queue.cc:260] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80b918a043c349ffbf6def634a4ea209" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 34135 } } peers { permanent_uuid: "5c8684cdc04f499b824ffca3b52c7e6e" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 36709 } } peers { permanent_uuid: "c41923657c0f43d2a65187483ef21dcf" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 44553 } }
I20260806 15:56:13.635435 17230 raft_consensus.cc:348] T d915234a98484e73b7f81e60f4a3c523 P 5c8684cdc04f499b824ffca3b52c7e6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80b918a043c349ffbf6def634a4ea209" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 34135 } } peers { permanent_uuid: "5c8684cdc04f499b824ffca3b52c7e6e" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 36709 } } peers { permanent_uuid: "c41923657c0f43d2a65187483ef21dcf" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 44553 } }
I20260806 15:56:13.635682 17230 raft_consensus.cc:729] T d915234a98484e73b7f81e60f4a3c523 P 5c8684cdc04f499b824ffca3b52c7e6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c8684cdc04f499b824ffca3b52c7e6e, State: Initialized, Role: FOLLOWER
I20260806 15:56:13.636008 17213 heartbeater.cc:503] Master 127.10.189.254:42417 was elected leader, sending a full tablet report...
I20260806 15:56:13.635952 17230 consensus_queue.cc:260] T d915234a98484e73b7f81e60f4a3c523 P 5c8684cdc04f499b824ffca3b52c7e6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80b918a043c349ffbf6def634a4ea209" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 34135 } } peers { permanent_uuid: "5c8684cdc04f499b824ffca3b52c7e6e" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 36709 } } peers { permanent_uuid: "c41923657c0f43d2a65187483ef21dcf" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 44553 } }
I20260806 15:56:13.636598 17231 ts_tablet_manager.cc:1428] T d915234a98484e73b7f81e60f4a3c523 P c41923657c0f43d2a65187483ef21dcf: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260806 15:56:13.637318 17232 ts_tablet_manager.cc:1428] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260806 15:56:13.637720 17230 ts_tablet_manager.cc:1428] T d915234a98484e73b7f81e60f4a3c523 P 5c8684cdc04f499b824ffca3b52c7e6e: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260806 15:56:13.637856 17078 heartbeater.cc:503] Master 127.10.189.254:42417 was elected leader, sending a full tablet report...
I20260806 15:56:13.649204 10999 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:56:13.650822 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver c41923657c0f43d2a65187483ef21dcf to finish bootstrapping
I20260806 15:56:13.657107 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 5c8684cdc04f499b824ffca3b52c7e6e to finish bootstrapping
I20260806 15:56:13.662302 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 80b918a043c349ffbf6def634a4ea209 to finish bootstrapping
I20260806 15:56:13.673038 17165 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d915234a98484e73b7f81e60f4a3c523"
dest_uuid: "80b918a043c349ffbf6def634a4ea209"
from {username='slave'} at 127.0.0.1:36034
I20260806 15:56:13.673270 17165 raft_consensus.cc:482] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:13.673421 17165 raft_consensus.cc:3037] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:13.674516 17165 raft_consensus.cc:504] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80b918a043c349ffbf6def634a4ea209" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 34135 } } peers { permanent_uuid: "5c8684cdc04f499b824ffca3b52c7e6e" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 36709 } } peers { permanent_uuid: "c41923657c0f43d2a65187483ef21dcf" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 44553 } }
I20260806 15:56:13.675532 17165 leader_election.cc:288] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209 [CANDIDATE]: Term 1 election: Requested vote from peers 5c8684cdc04f499b824ffca3b52c7e6e (127.10.189.194:36709), c41923657c0f43d2a65187483ef21dcf (127.10.189.193:44553)
I20260806 15:56:13.680420 17030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d915234a98484e73b7f81e60f4a3c523" candidate_uuid: "80b918a043c349ffbf6def634a4ea209" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5c8684cdc04f499b824ffca3b52c7e6e"
I20260806 15:56:13.680682 17030 raft_consensus.cc:3037] T d915234a98484e73b7f81e60f4a3c523 P 5c8684cdc04f499b824ffca3b52c7e6e [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:13.680752 16894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d915234a98484e73b7f81e60f4a3c523" candidate_uuid: "80b918a043c349ffbf6def634a4ea209" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c41923657c0f43d2a65187483ef21dcf"
I20260806 15:56:13.680994 16894 raft_consensus.cc:3037] T d915234a98484e73b7f81e60f4a3c523 P c41923657c0f43d2a65187483ef21dcf [term 0 FOLLOWER]: Advancing to term 1
W20260806 15:56:13.680797 16944 tablet.cc:2369] T d915234a98484e73b7f81e60f4a3c523 P c41923657c0f43d2a65187483ef21dcf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:56:13.682098 17030 raft_consensus.cc:2454] T d915234a98484e73b7f81e60f4a3c523 P 5c8684cdc04f499b824ffca3b52c7e6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80b918a043c349ffbf6def634a4ea209 in term 1.
I20260806 15:56:13.682278 16894 raft_consensus.cc:2454] T d915234a98484e73b7f81e60f4a3c523 P c41923657c0f43d2a65187483ef21dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80b918a043c349ffbf6def634a4ea209 in term 1.
I20260806 15:56:13.682586 17096 leader_election.cc:302] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c8684cdc04f499b824ffca3b52c7e6e, 80b918a043c349ffbf6def634a4ea209; no voters:
I20260806 15:56:13.682942 17237 raft_consensus.cc:2781] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:13.683187 17237 raft_consensus.cc:686] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209 [term 1 LEADER]: Becoming Leader. State: Replica: 80b918a043c349ffbf6def634a4ea209, State: Running, Role: LEADER
I20260806 15:56:13.683519 17237 consensus_queue.cc:237] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80b918a043c349ffbf6def634a4ea209" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 34135 } } peers { permanent_uuid: "5c8684cdc04f499b824ffca3b52c7e6e" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 36709 } } peers { permanent_uuid: "c41923657c0f43d2a65187483ef21dcf" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 44553 } }
I20260806 15:56:13.686883 16741 catalog_manager.cc:5495] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80b918a043c349ffbf6def634a4ea209 (127.10.189.195). New cstate: current_term: 1 leader_uuid: "80b918a043c349ffbf6def634a4ea209" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80b918a043c349ffbf6def634a4ea209" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 34135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c8684cdc04f499b824ffca3b52c7e6e" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 36709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41923657c0f43d2a65187483ef21dcf" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 44553 } health_report { overall_health: UNKNOWN } } }
I20260806 15:56:13.692559 16894 raft_consensus.cc:1261] T d915234a98484e73b7f81e60f4a3c523 P c41923657c0f43d2a65187483ef21dcf [term 1 FOLLOWER]: Refusing update from remote peer 80b918a043c349ffbf6def634a4ea209: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:56:13.692598 17030 raft_consensus.cc:1261] T d915234a98484e73b7f81e60f4a3c523 P 5c8684cdc04f499b824ffca3b52c7e6e [term 1 FOLLOWER]: Refusing update from remote peer 80b918a043c349ffbf6def634a4ea209: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:56:13.693298 17242 consensus_queue.cc:1035] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c8684cdc04f499b824ffca3b52c7e6e" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 36709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:56:13.693445 17237 consensus_queue.cc:1035] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41923657c0f43d2a65187483ef21dcf" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:56:13.700659 17245 mvcc.cc:205] Tried to move back new op lower bound from 7315586145038180352 to 7315586145010827264. Current Snapshot: MvccSnapshot[applied={T|T < 7315586145038180352}]
I20260806 15:56:13.714864 17165 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d915234a98484e73b7f81e60f4a3c523"
dest_uuid: "80b918a043c349ffbf6def634a4ea209"
from {username='slave'} at 127.0.0.1:36034
I20260806 15:56:13.715018 17165 raft_consensus.cc:580] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209 [term 1 LEADER]: Received request to step down
I20260806 15:56:13.715060 17165 raft_consensus.cc:3032] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209 [term 1 LEADER]: Stepping down as leader of term 1
I20260806 15:56:13.715086 17165 raft_consensus.cc:729] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80b918a043c349ffbf6def634a4ea209, State: Running, Role: LEADER
I20260806 15:56:13.715179 17165 consensus_queue.cc:260] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80b918a043c349ffbf6def634a4ea209" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 34135 } } peers { permanent_uuid: "5c8684cdc04f499b824ffca3b52c7e6e" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 36709 } } peers { permanent_uuid: "c41923657c0f43d2a65187483ef21dcf" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 44553 } }
I20260806 15:56:13.715391 17165 raft_consensus.cc:3037] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:13.716626 17165 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d915234a98484e73b7f81e60f4a3c523"
dest_uuid: "80b918a043c349ffbf6def634a4ea209"
from {username='slave'} at 127.0.0.1:36034
I20260806 15:56:13.716732 17165 raft_consensus.cc:573] T d915234a98484e73b7f81e60f4a3c523 P 80b918a043c349ffbf6def634a4ea209 [term 2 FOLLOWER]: Rejecting request to step down while not leader
W20260806 15:56:13.718040 17123 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36034: Illegal state: replica 80b918a043c349ffbf6def634a4ea209 is not leader of this config: current role FOLLOWER
I20260806 15:56:13.718863 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 16809
I20260806 15:56:13.727720 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 16946
I20260806 15:56:13.733881 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 17081
I20260806 15:56:13.740020 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 16714
2026-08-06T15:56:13Z chronyd exiting
[ OK ] RaftConsensusElectionITest.LeaderStepDown (1031 ms)
[ RUN ] RaftConsensusElectionITest.StepDownWithSlowFollower
I20260806 15:56:13.762466 10999 test_util.cc:268] Using random seed: -311508068
I20260806 15:56:13.763268 10999 ts_itest-base.cc:112] Starting cluster with:
I20260806 15:56:13.763314 10999 ts_itest-base.cc:113] --------------
I20260806 15:56:13.763325 10999 ts_itest-base.cc:114] 3 tablet servers
I20260806 15:56:13.763336 10999 ts_itest-base.cc:115] 3 replicas per TS
I20260806 15:56:13.763376 10999 ts_itest-base.cc:116] --------------
2026-08-06T15:56:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:56:13Z Disabled control of system clock
I20260806 15:56:13.772727 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:42497
--webserver_interface=127.10.189.254
--webserver_port=0
--builtin_ntp_servers=127.10.189.212:43641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.189.254:42497
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260806 15:56:13.883744 17260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:13.884068 17260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:13.884141 17260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:13.888199 17260 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:56:13.888295 17260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:13.888330 17260 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:56:13.888367 17260 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:56:13.893134 17260 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:43641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.10.189.254:42497
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:42497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.10.189.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.17260
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:13.894335 17260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:13.895776 17260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:13.904398 17265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:13.904410 17266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:13.904398 17268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:13.904714 17260 server_base.cc:1034] running on GCE node
I20260806 15:56:13.905431 17260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:13.906569 17260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:13.907795 17260 hybrid_clock.cc:648] HybridClock initialized: now 1786031773907768 us; error 32 us; skew 500 ppm
I20260806 15:56:13.909686 17260 webserver.cc:460] Webserver started at http://127.10.189.254:40427/ using document root <none> and password file <none>
I20260806 15:56:13.910301 17260 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:13.910372 17260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:13.910540 17260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:13.912345 17260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "7b43e8e180c94573b91b0a3c13556e78"
format_stamp: "Formatted at 2026-08-06 15:56:13 on dist-test-slave-mn4r"
I20260806 15:56:13.912845 17260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "7b43e8e180c94573b91b0a3c13556e78"
format_stamp: "Formatted at 2026-08-06 15:56:13 on dist-test-slave-mn4r"
I20260806 15:56:13.916354 17260 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 15:56:13.918651 17274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:13.919862 17260 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 15:56:13.919974 17260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
uuid: "7b43e8e180c94573b91b0a3c13556e78"
format_stamp: "Formatted at 2026-08-06 15:56:13 on dist-test-slave-mn4r"
I20260806 15:56:13.920058 17260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:13.950850 17260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:13.951566 17260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:13.951728 17260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:13.958674 17260 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.254:42497
I20260806 15:56:13.958684 17328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.254:42497 every 8 connection(s)
I20260806 15:56:13.959664 17260 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260806 15:56:13.963079 17329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:13.968083 17329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78: Bootstrap starting.
I20260806 15:56:13.969129 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 17260
I20260806 15:56:13.969233 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260806 15:56:13.970857 17329 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:13.971791 17329 log.cc:824] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:13.973978 17329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78: No bootstrap required, opened a new log
I20260806 15:56:13.978227 17329 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b43e8e180c94573b91b0a3c13556e78" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42497 } }
I20260806 15:56:13.978518 17329 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:56:13.978592 17329 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b43e8e180c94573b91b0a3c13556e78, State: Initialized, Role: FOLLOWER
I20260806 15:56:13.979117 17329 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b43e8e180c94573b91b0a3c13556e78" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42497 } }
I20260806 15:56:13.979279 17329 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:56:13.979347 17329 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:56:13.979444 17329 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:13.980358 17329 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b43e8e180c94573b91b0a3c13556e78" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42497 } }
I20260806 15:56:13.980719 17329 leader_election.cc:302] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b43e8e180c94573b91b0a3c13556e78; no voters:
I20260806 15:56:13.981065 17329 leader_election.cc:288] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:56:13.981208 17334 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:13.981500 17334 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78 [term 1 LEADER]: Becoming Leader. State: Replica: 7b43e8e180c94573b91b0a3c13556e78, State: Running, Role: LEADER
I20260806 15:56:13.981829 17334 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b43e8e180c94573b91b0a3c13556e78" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42497 } }
I20260806 15:56:13.982416 17329 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:56:13.983716 17336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b43e8e180c94573b91b0a3c13556e78. Latest consensus state: current_term: 1 leader_uuid: "7b43e8e180c94573b91b0a3c13556e78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b43e8e180c94573b91b0a3c13556e78" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42497 } } }
I20260806 15:56:13.983722 17335 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b43e8e180c94573b91b0a3c13556e78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b43e8e180c94573b91b0a3c13556e78" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42497 } } }
I20260806 15:56:13.983860 17335 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78 [sys.catalog]: This master's current role is: LEADER
I20260806 15:56:13.983855 17336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78 [sys.catalog]: This master's current role is: LEADER
I20260806 15:56:13.984380 17343 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:56:13.987660 17343 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:56:13.993348 17343 catalog_manager.cc:1347] Generated new cluster ID: a792b2c608e140a2bb2c0761792dfeac
I20260806 15:56:13.993431 17343 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:56:14.023244 17343 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:56:14.024369 17343 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:56:14.035693 17343 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b43e8e180c94573b91b0a3c13556e78: Generated new TSK 0
I20260806 15:56:14.036546 17343 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:56:14.050211 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.193:0
--local_ip_for_outbound_sockets=127.10.189.193
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42497
--builtin_ntp_servers=127.10.189.212:43641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--consensus_rpc_timeout_ms=15000 with env {}
W20260806 15:56:14.164191 17354 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:56:14.164450 17354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:14.164469 17354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:14.164500 17354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:14.168553 17354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:14.168641 17354 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.193
I20260806 15:56:14.173168 17354 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:43641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=15000
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42497
--never_fsync=true
--heap_profile_path=/tmp/kudu.17354
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.193
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:14.174233 17354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:14.175583 17354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 15:56:14.185765 17354 server_base.cc:1034] running on GCE node
W20260806 15:56:14.185716 17362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:14.185741 17359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:14.185724 17360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:14.186477 17354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:14.187148 17354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:14.188310 17354 hybrid_clock.cc:648] HybridClock initialized: now 1786031774188289 us; error 34 us; skew 500 ppm
I20260806 15:56:14.190163 17354 webserver.cc:460] Webserver started at http://127.10.189.193:43733/ using document root <none> and password file <none>
I20260806 15:56:14.190748 17354 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:14.190810 17354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:14.191046 17354 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:14.192930 17354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "6833884c497e4861be06ffc0bd3cb632"
format_stamp: "Formatted at 2026-08-06 15:56:14 on dist-test-slave-mn4r"
I20260806 15:56:14.193487 17354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "6833884c497e4861be06ffc0bd3cb632"
format_stamp: "Formatted at 2026-08-06 15:56:14 on dist-test-slave-mn4r"
I20260806 15:56:14.197101 17354 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260806 15:56:14.199409 17368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:14.200539 17354 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 15:56:14.200666 17354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "6833884c497e4861be06ffc0bd3cb632"
format_stamp: "Formatted at 2026-08-06 15:56:14 on dist-test-slave-mn4r"
I20260806 15:56:14.200762 17354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:14.212149 17354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:14.212802 17354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:14.212998 17354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:14.213583 17354 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:14.214520 17354 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:14.214582 17354 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:14.214666 17354 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:14.214697 17354 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:14.223755 17354 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.193:46107
I20260806 15:56:14.223860 17485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.193:46107 every 8 connection(s)
I20260806 15:56:14.224869 17354 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260806 15:56:14.226713 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 17354
I20260806 15:56:14.226852 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260806 15:56:14.229095 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.194:0
--local_ip_for_outbound_sockets=127.10.189.194
--webserver_interface=127.10.189.194
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42497
--builtin_ntp_servers=127.10.189.212:43641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--consensus_rpc_timeout_ms=15000 with env {}
I20260806 15:56:14.237268 17486 heartbeater.cc:347] Connected to a master server at 127.10.189.254:42497
I20260806 15:56:14.237557 17486 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:14.238195 17486 heartbeater.cc:511] Master 127.10.189.254:42497 requested a full tablet report, sending...
I20260806 15:56:14.240079 17291 ts_manager.cc:194] Registered new tserver with Master: 6833884c497e4861be06ffc0bd3cb632 (127.10.189.193:46107)
I20260806 15:56:14.242036 17291 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.193:53449
W20260806 15:56:14.344888 17489 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:56:14.345160 17489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:14.345180 17489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:14.345211 17489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:14.349304 17489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:14.349426 17489 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.194
I20260806 15:56:14.354671 17489 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:43641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=15000
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.10.189.194
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42497
--never_fsync=true
--heap_profile_path=/tmp/kudu.17489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.194
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:14.355842 17489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:14.357297 17489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:14.367377 17494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:14.367372 17497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:14.367579 17495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:14.367450 17489 server_base.cc:1034] running on GCE node
I20260806 15:56:14.368062 17489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:14.368705 17489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:14.369886 17489 hybrid_clock.cc:648] HybridClock initialized: now 1786031774369866 us; error 42 us; skew 500 ppm
I20260806 15:56:14.371857 17489 webserver.cc:460] Webserver started at http://127.10.189.194:46387/ using document root <none> and password file <none>
I20260806 15:56:14.372443 17489 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:14.372534 17489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:14.372762 17489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:14.374738 17489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "25bf080ff0da453abcbdcdaaad073d62"
format_stamp: "Formatted at 2026-08-06 15:56:14 on dist-test-slave-mn4r"
I20260806 15:56:14.375291 17489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "25bf080ff0da453abcbdcdaaad073d62"
format_stamp: "Formatted at 2026-08-06 15:56:14 on dist-test-slave-mn4r"
I20260806 15:56:14.379016 17489 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 15:56:14.381508 17503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:14.382898 17489 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 15:56:14.383065 17489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "25bf080ff0da453abcbdcdaaad073d62"
format_stamp: "Formatted at 2026-08-06 15:56:14 on dist-test-slave-mn4r"
I20260806 15:56:14.383174 17489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:14.412636 17489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:14.413407 17489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:14.413614 17489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:14.414275 17489 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:14.415262 17489 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:14.415333 17489 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:14.415403 17489 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:14.415457 17489 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:14.425144 17489 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.194:37599
I20260806 15:56:14.425181 17620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.194:37599 every 8 connection(s)
I20260806 15:56:14.426124 17489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260806 15:56:14.426697 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 17489
I20260806 15:56:14.426815 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260806 15:56:14.429241 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.195:0
--local_ip_for_outbound_sockets=127.10.189.195
--webserver_interface=127.10.189.195
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42497
--builtin_ntp_servers=127.10.189.212:43641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--consensus_rpc_timeout_ms=15000 with env {}
I20260806 15:56:14.437721 17621 heartbeater.cc:347] Connected to a master server at 127.10.189.254:42497
I20260806 15:56:14.438023 17621 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:14.438787 17621 heartbeater.cc:511] Master 127.10.189.254:42497 requested a full tablet report, sending...
I20260806 15:56:14.440057 17291 ts_manager.cc:194] Registered new tserver with Master: 25bf080ff0da453abcbdcdaaad073d62 (127.10.189.194:37599)
I20260806 15:56:14.440665 17291 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.194:45435
W20260806 15:56:14.543694 17624 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:56:14.543953 17624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:14.543973 17624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:14.544040 17624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:14.548151 17624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:14.548252 17624 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.195
I20260806 15:56:14.552919 17624 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:43641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=15000
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.189.195
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42497
--never_fsync=true
--heap_profile_path=/tmp/kudu.17624
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.195
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:14.553972 17624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:14.555347 17624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:14.564685 17632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:14.564790 17629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:14.564678 17630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:14.565336 17624 server_base.cc:1034] running on GCE node
I20260806 15:56:14.565778 17624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:14.566529 17624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:14.567745 17624 hybrid_clock.cc:648] HybridClock initialized: now 1786031774567714 us; error 49 us; skew 500 ppm
I20260806 15:56:14.569809 17624 webserver.cc:460] Webserver started at http://127.10.189.195:35831/ using document root <none> and password file <none>
I20260806 15:56:14.570540 17624 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:14.570643 17624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:14.570911 17624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:14.572966 17624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "3c43b972ce78415b8b1f94501b74afc1"
format_stamp: "Formatted at 2026-08-06 15:56:14 on dist-test-slave-mn4r"
I20260806 15:56:14.573578 17624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "3c43b972ce78415b8b1f94501b74afc1"
format_stamp: "Formatted at 2026-08-06 15:56:14 on dist-test-slave-mn4r"
I20260806 15:56:14.577546 17624 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260806 15:56:14.580201 17639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:14.581487 17624 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260806 15:56:14.581635 17624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "3c43b972ce78415b8b1f94501b74afc1"
format_stamp: "Formatted at 2026-08-06 15:56:14 on dist-test-slave-mn4r"
I20260806 15:56:14.581754 17624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:14.603456 17624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:14.604327 17624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:14.604552 17624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:14.605269 17624 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:14.606441 17624 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:14.606519 17624 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:14.606600 17624 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:14.606658 17624 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:14.616061 17624 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.195:42389
I20260806 15:56:14.616099 17757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.195:42389 every 8 connection(s)
I20260806 15:56:14.617095 17624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260806 15:56:14.626641 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 17624
I20260806 15:56:14.626806 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260806 15:56:14.628371 17758 heartbeater.cc:347] Connected to a master server at 127.10.189.254:42497
I20260806 15:56:14.628712 17758 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:14.629426 17758 heartbeater.cc:511] Master 127.10.189.254:42497 requested a full tablet report, sending...
I20260806 15:56:14.630481 17291 ts_manager.cc:194] Registered new tserver with Master: 3c43b972ce78415b8b1f94501b74afc1 (127.10.189.195:42389)
I20260806 15:56:14.631052 17291 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.195:54515
I20260806 15:56:14.641424 10999 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:56:14.651921 17291 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43794:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
W20260806 15:56:14.655055 17291 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:56:14.674139 17689 tablet_service.cc:1467] Processing CreateTablet for tablet d455e52daf214bbaa90c01de278ffacd (DEFAULT_TABLE table=TestTable [id=a2eff2d48ea645549ba6dade09a6efbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:14.674145 17418 tablet_service.cc:1467] Processing CreateTablet for tablet d455e52daf214bbaa90c01de278ffacd (DEFAULT_TABLE table=TestTable [id=a2eff2d48ea645549ba6dade09a6efbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:14.675196 17689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d455e52daf214bbaa90c01de278ffacd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:14.675248 17418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d455e52daf214bbaa90c01de278ffacd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:14.676040 17553 tablet_service.cc:1467] Processing CreateTablet for tablet d455e52daf214bbaa90c01de278ffacd (DEFAULT_TABLE table=TestTable [id=a2eff2d48ea645549ba6dade09a6efbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:14.677039 17553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d455e52daf214bbaa90c01de278ffacd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:14.680948 17775 tablet_bootstrap.cc:492] T d455e52daf214bbaa90c01de278ffacd P 3c43b972ce78415b8b1f94501b74afc1: Bootstrap starting.
I20260806 15:56:14.683013 17776 tablet_bootstrap.cc:492] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632: Bootstrap starting.
I20260806 15:56:14.683390 17775 tablet_bootstrap.cc:654] T d455e52daf214bbaa90c01de278ffacd P 3c43b972ce78415b8b1f94501b74afc1: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:14.684404 17775 log.cc:824] T d455e52daf214bbaa90c01de278ffacd P 3c43b972ce78415b8b1f94501b74afc1: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:14.684417 17777 tablet_bootstrap.cc:492] T d455e52daf214bbaa90c01de278ffacd P 25bf080ff0da453abcbdcdaaad073d62: Bootstrap starting.
I20260806 15:56:14.685321 17776 tablet_bootstrap.cc:654] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:14.686352 17776 log.cc:824] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:14.686616 17775 tablet_bootstrap.cc:492] T d455e52daf214bbaa90c01de278ffacd P 3c43b972ce78415b8b1f94501b74afc1: No bootstrap required, opened a new log
I20260806 15:56:14.686808 17775 ts_tablet_manager.cc:1397] T d455e52daf214bbaa90c01de278ffacd P 3c43b972ce78415b8b1f94501b74afc1: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 15:56:14.686928 17777 tablet_bootstrap.cc:654] T d455e52daf214bbaa90c01de278ffacd P 25bf080ff0da453abcbdcdaaad073d62: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:14.687789 17777 log.cc:824] T d455e52daf214bbaa90c01de278ffacd P 25bf080ff0da453abcbdcdaaad073d62: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:14.688454 17776 tablet_bootstrap.cc:492] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632: No bootstrap required, opened a new log
I20260806 15:56:14.688673 17776 ts_tablet_manager.cc:1397] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260806 15:56:14.689719 17777 tablet_bootstrap.cc:492] T d455e52daf214bbaa90c01de278ffacd P 25bf080ff0da453abcbdcdaaad073d62: No bootstrap required, opened a new log
I20260806 15:56:14.689900 17777 ts_tablet_manager.cc:1397] T d455e52daf214bbaa90c01de278ffacd P 25bf080ff0da453abcbdcdaaad073d62: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 15:56:14.690840 17775 raft_consensus.cc:348] T d455e52daf214bbaa90c01de278ffacd P 3c43b972ce78415b8b1f94501b74afc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43b972ce78415b8b1f94501b74afc1" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42389 } } peers { permanent_uuid: "6833884c497e4861be06ffc0bd3cb632" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 46107 } } peers { permanent_uuid: "25bf080ff0da453abcbdcdaaad073d62" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37599 } }
I20260806 15:56:14.691094 17775 raft_consensus.cc:729] T d455e52daf214bbaa90c01de278ffacd P 3c43b972ce78415b8b1f94501b74afc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c43b972ce78415b8b1f94501b74afc1, State: Initialized, Role: FOLLOWER
I20260806 15:56:14.691424 17775 consensus_queue.cc:260] T d455e52daf214bbaa90c01de278ffacd P 3c43b972ce78415b8b1f94501b74afc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43b972ce78415b8b1f94501b74afc1" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42389 } } peers { permanent_uuid: "6833884c497e4861be06ffc0bd3cb632" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 46107 } } peers { permanent_uuid: "25bf080ff0da453abcbdcdaaad073d62" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37599 } }
I20260806 15:56:14.692538 17775 ts_tablet_manager.cc:1428] T d455e52daf214bbaa90c01de278ffacd P 3c43b972ce78415b8b1f94501b74afc1: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260806 15:56:14.692919 17758 heartbeater.cc:503] Master 127.10.189.254:42497 was elected leader, sending a full tablet report...
I20260806 15:56:14.693152 17776 raft_consensus.cc:348] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43b972ce78415b8b1f94501b74afc1" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42389 } } peers { permanent_uuid: "6833884c497e4861be06ffc0bd3cb632" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 46107 } } peers { permanent_uuid: "25bf080ff0da453abcbdcdaaad073d62" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37599 } }
I20260806 15:56:14.693401 17776 raft_consensus.cc:729] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6833884c497e4861be06ffc0bd3cb632, State: Initialized, Role: FOLLOWER
I20260806 15:56:14.693693 17776 consensus_queue.cc:260] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43b972ce78415b8b1f94501b74afc1" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42389 } } peers { permanent_uuid: "6833884c497e4861be06ffc0bd3cb632" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 46107 } } peers { permanent_uuid: "25bf080ff0da453abcbdcdaaad073d62" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37599 } }
I20260806 15:56:14.694391 17486 heartbeater.cc:503] Master 127.10.189.254:42497 was elected leader, sending a full tablet report...
I20260806 15:56:14.694262 17777 raft_consensus.cc:348] T d455e52daf214bbaa90c01de278ffacd P 25bf080ff0da453abcbdcdaaad073d62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43b972ce78415b8b1f94501b74afc1" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42389 } } peers { permanent_uuid: "6833884c497e4861be06ffc0bd3cb632" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 46107 } } peers { permanent_uuid: "25bf080ff0da453abcbdcdaaad073d62" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37599 } }
I20260806 15:56:14.694494 17777 raft_consensus.cc:729] T d455e52daf214bbaa90c01de278ffacd P 25bf080ff0da453abcbdcdaaad073d62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25bf080ff0da453abcbdcdaaad073d62, State: Initialized, Role: FOLLOWER
I20260806 15:56:14.694700 17776 ts_tablet_manager.cc:1428] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632: Time spent starting tablet: real 0.006s user 0.005s sys 0.002s
I20260806 15:56:14.694767 17777 consensus_queue.cc:260] T d455e52daf214bbaa90c01de278ffacd P 25bf080ff0da453abcbdcdaaad073d62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43b972ce78415b8b1f94501b74afc1" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42389 } } peers { permanent_uuid: "6833884c497e4861be06ffc0bd3cb632" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 46107 } } peers { permanent_uuid: "25bf080ff0da453abcbdcdaaad073d62" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37599 } }
I20260806 15:56:14.695452 17621 heartbeater.cc:503] Master 127.10.189.254:42497 was elected leader, sending a full tablet report...
I20260806 15:56:14.695714 17777 ts_tablet_manager.cc:1428] T d455e52daf214bbaa90c01de278ffacd P 25bf080ff0da453abcbdcdaaad073d62: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260806 15:56:14.702464 10999 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:56:14.703797 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 6833884c497e4861be06ffc0bd3cb632 to finish bootstrapping
I20260806 15:56:14.709939 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 25bf080ff0da453abcbdcdaaad073d62 to finish bootstrapping
I20260806 15:56:14.715039 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 3c43b972ce78415b8b1f94501b74afc1 to finish bootstrapping
I20260806 15:56:14.725073 17438 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d455e52daf214bbaa90c01de278ffacd"
dest_uuid: "6833884c497e4861be06ffc0bd3cb632"
from {username='slave'} at 127.0.0.1:47306
I20260806 15:56:14.725317 17438 raft_consensus.cc:482] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:14.725489 17438 raft_consensus.cc:3037] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632 [term 0 FOLLOWER]: Advancing to term 1
W20260806 15:56:14.726042 17487 tablet.cc:2369] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:56:14.726675 17438 raft_consensus.cc:504] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43b972ce78415b8b1f94501b74afc1" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42389 } } peers { permanent_uuid: "6833884c497e4861be06ffc0bd3cb632" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 46107 } } peers { permanent_uuid: "25bf080ff0da453abcbdcdaaad073d62" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37599 } }
I20260806 15:56:14.727680 17438 leader_election.cc:288] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632 [CANDIDATE]: Term 1 election: Requested vote from peers 3c43b972ce78415b8b1f94501b74afc1 (127.10.189.195:42389), 25bf080ff0da453abcbdcdaaad073d62 (127.10.189.194:37599)
I20260806 15:56:14.732031 17574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d455e52daf214bbaa90c01de278ffacd" candidate_uuid: "6833884c497e4861be06ffc0bd3cb632" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "25bf080ff0da453abcbdcdaaad073d62"
I20260806 15:56:14.732262 17574 raft_consensus.cc:3037] T d455e52daf214bbaa90c01de278ffacd P 25bf080ff0da453abcbdcdaaad073d62 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:14.732517 17710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d455e52daf214bbaa90c01de278ffacd" candidate_uuid: "6833884c497e4861be06ffc0bd3cb632" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3c43b972ce78415b8b1f94501b74afc1"
I20260806 15:56:14.732725 17710 raft_consensus.cc:3037] T d455e52daf214bbaa90c01de278ffacd P 3c43b972ce78415b8b1f94501b74afc1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:14.733364 17574 raft_consensus.cc:2454] T d455e52daf214bbaa90c01de278ffacd P 25bf080ff0da453abcbdcdaaad073d62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6833884c497e4861be06ffc0bd3cb632 in term 1.
I20260806 15:56:14.733821 17710 raft_consensus.cc:2454] T d455e52daf214bbaa90c01de278ffacd P 3c43b972ce78415b8b1f94501b74afc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6833884c497e4861be06ffc0bd3cb632 in term 1.
I20260806 15:56:14.733861 17372 leader_election.cc:302] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25bf080ff0da453abcbdcdaaad073d62, 6833884c497e4861be06ffc0bd3cb632; no voters:
I20260806 15:56:14.734212 17783 raft_consensus.cc:2781] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:14.734700 17783 raft_consensus.cc:686] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632 [term 1 LEADER]: Becoming Leader. State: Replica: 6833884c497e4861be06ffc0bd3cb632, State: Running, Role: LEADER
I20260806 15:56:14.735212 17783 consensus_queue.cc:237] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43b972ce78415b8b1f94501b74afc1" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42389 } } peers { permanent_uuid: "6833884c497e4861be06ffc0bd3cb632" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 46107 } } peers { permanent_uuid: "25bf080ff0da453abcbdcdaaad073d62" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37599 } }
I20260806 15:56:14.739059 17290 catalog_manager.cc:5495] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6833884c497e4861be06ffc0bd3cb632 (127.10.189.193). New cstate: current_term: 1 leader_uuid: "6833884c497e4861be06ffc0bd3cb632" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43b972ce78415b8b1f94501b74afc1" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6833884c497e4861be06ffc0bd3cb632" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25bf080ff0da453abcbdcdaaad073d62" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37599 } health_report { overall_health: UNKNOWN } } }
I20260806 15:56:15.760377 17438 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d455e52daf214bbaa90c01de278ffacd"
dest_uuid: "6833884c497e4861be06ffc0bd3cb632"
from {username='slave'} at 127.0.0.1:47306
I20260806 15:56:15.760649 17438 raft_consensus.cc:580] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632 [term 1 LEADER]: Received request to step down
I20260806 15:56:15.760726 17438 raft_consensus.cc:3032] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632 [term 1 LEADER]: Stepping down as leader of term 1
I20260806 15:56:15.760771 17438 raft_consensus.cc:729] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6833884c497e4861be06ffc0bd3cb632, State: Running, Role: LEADER
I20260806 15:56:15.760962 17438 consensus_queue.cc:260] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43b972ce78415b8b1f94501b74afc1" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42389 } } peers { permanent_uuid: "6833884c497e4861be06ffc0bd3cb632" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 46107 } } peers { permanent_uuid: "25bf080ff0da453abcbdcdaaad073d62" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 37599 } }
I20260806 15:56:15.761128 17438 raft_consensus.cc:3037] T d455e52daf214bbaa90c01de278ffacd P 6833884c497e4861be06ffc0bd3cb632 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:15.762005 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 17354
I20260806 15:56:15.769271 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 17489
I20260806 15:56:15.775225 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 17624
I20260806 15:56:15.782352 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 17260
2026-08-06T15:56:15Z chronyd exiting
[ OK ] RaftConsensusElectionITest.StepDownWithSlowFollower (2041 ms)
[ RUN ] RaftConsensusElectionITest.ElectPendingVoter
I20260806 15:56:15.803799 10999 test_util.cc:268] Using random seed: -309466734
I20260806 15:56:15.804534 10999 ts_itest-base.cc:112] Starting cluster with:
I20260806 15:56:15.804571 10999 ts_itest-base.cc:113] --------------
I20260806 15:56:15.804582 10999 ts_itest-base.cc:114] 5 tablet servers
I20260806 15:56:15.804593 10999 ts_itest-base.cc:115] 5 replicas per TS
I20260806 15:56:15.804605 10999 ts_itest-base.cc:116] --------------
2026-08-06T15:56:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:56:15Z Disabled control of system clock
I20260806 15:56:15.813684 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:43133
--webserver_interface=127.10.189.254
--webserver_port=0
--builtin_ntp_servers=127.10.189.212:42325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.189.254:43133
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260806 15:56:15.923455 17797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:15.923765 17797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:15.923840 17797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:15.927892 17797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:56:15.927980 17797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:15.928013 17797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:56:15.928051 17797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:56:15.932765 17797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:42325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.10.189.254:43133
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:43133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.10.189.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.17797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:15.933872 17797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:15.935326 17797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:15.943759 17803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:15.943753 17805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:15.943753 17802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:15.943811 17797 server_base.cc:1034] running on GCE node
I20260806 15:56:15.944517 17797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:15.945582 17797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:15.946787 17797 hybrid_clock.cc:648] HybridClock initialized: now 1786031775946771 us; error 25 us; skew 500 ppm
I20260806 15:56:15.949290 17797 webserver.cc:460] Webserver started at http://127.10.189.254:34315/ using document root <none> and password file <none>
I20260806 15:56:15.949922 17797 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:15.950028 17797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:15.950287 17797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:15.952333 17797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "27624023d3f54d30b4a8c6f646b03461"
format_stamp: "Formatted at 2026-08-06 15:56:15 on dist-test-slave-mn4r"
I20260806 15:56:15.952970 17797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "27624023d3f54d30b4a8c6f646b03461"
format_stamp: "Formatted at 2026-08-06 15:56:15 on dist-test-slave-mn4r"
I20260806 15:56:15.957018 17797 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 15:56:15.959774 17811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:15.961035 17797 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260806 15:56:15.961186 17797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
uuid: "27624023d3f54d30b4a8c6f646b03461"
format_stamp: "Formatted at 2026-08-06 15:56:15 on dist-test-slave-mn4r"
I20260806 15:56:15.961304 17797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:15.977566 17797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:15.978411 17797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:15.978628 17797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:15.986343 17797 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.254:43133
I20260806 15:56:15.986349 17865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.254:43133 every 8 connection(s)
I20260806 15:56:15.987362 17797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260806 15:56:15.989382 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 17797
I20260806 15:56:15.989547 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260806 15:56:15.991012 17866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:15.997510 17866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461: Bootstrap starting.
I20260806 15:56:16.000113 17866 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:16.000845 17866 log.cc:824] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:16.002624 17866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461: No bootstrap required, opened a new log
I20260806 15:56:16.006172 17866 raft_consensus.cc:348] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27624023d3f54d30b4a8c6f646b03461" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 43133 } }
I20260806 15:56:16.006402 17866 raft_consensus.cc:374] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:56:16.006477 17866 raft_consensus.cc:729] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27624023d3f54d30b4a8c6f646b03461, State: Initialized, Role: FOLLOWER
I20260806 15:56:16.006933 17866 consensus_queue.cc:260] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27624023d3f54d30b4a8c6f646b03461" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 43133 } }
I20260806 15:56:16.007087 17866 raft_consensus.cc:388] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:56:16.007174 17866 raft_consensus.cc:482] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:56:16.007270 17866 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:16.008059 17866 raft_consensus.cc:504] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27624023d3f54d30b4a8c6f646b03461" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 43133 } }
I20260806 15:56:16.008386 17866 leader_election.cc:302] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 27624023d3f54d30b4a8c6f646b03461; no voters:
I20260806 15:56:16.008677 17866 leader_election.cc:288] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:56:16.008792 17872 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:16.009104 17872 raft_consensus.cc:686] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461 [term 1 LEADER]: Becoming Leader. State: Replica: 27624023d3f54d30b4a8c6f646b03461, State: Running, Role: LEADER
I20260806 15:56:16.009478 17872 consensus_queue.cc:237] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27624023d3f54d30b4a8c6f646b03461" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 43133 } }
I20260806 15:56:16.009958 17866 sys_catalog.cc:564] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:56:16.011243 17873 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 27624023d3f54d30b4a8c6f646b03461. Latest consensus state: current_term: 1 leader_uuid: "27624023d3f54d30b4a8c6f646b03461" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27624023d3f54d30b4a8c6f646b03461" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 43133 } } }
I20260806 15:56:16.011243 17874 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "27624023d3f54d30b4a8c6f646b03461" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27624023d3f54d30b4a8c6f646b03461" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 43133 } } }
I20260806 15:56:16.011390 17873 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461 [sys.catalog]: This master's current role is: LEADER
I20260806 15:56:16.011390 17874 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461 [sys.catalog]: This master's current role is: LEADER
I20260806 15:56:16.011835 17883 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:56:16.014906 17883 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:56:16.019949 17883 catalog_manager.cc:1347] Generated new cluster ID: 51a9b87ed3864ea38fe681a1f6b67222
I20260806 15:56:16.020021 17883 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:56:16.033672 17883 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:56:16.034638 17883 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:56:16.040305 17883 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 27624023d3f54d30b4a8c6f646b03461: Generated new TSK 0
I20260806 15:56:16.040946 17883 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:56:16.044143 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.193:0
--local_ip_for_outbound_sockets=127.10.189.193
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:43133
--builtin_ntp_servers=127.10.189.212:42325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260806 15:56:16.159365 17892 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:56:16.159636 17892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:16.159657 17892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:16.159726 17892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:16.163761 17892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:16.163887 17892 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.193
I20260806 15:56:16.168787 17892 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:42325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:43133
--never_fsync=true
--heap_profile_path=/tmp/kudu.17892
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.193
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:16.169909 17892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:16.171386 17892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:16.180928 17900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:16.180928 17897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:16.180998 17898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:16.181151 17892 server_base.cc:1034] running on GCE node
I20260806 15:56:16.181674 17892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:16.182404 17892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:16.183562 17892 hybrid_clock.cc:648] HybridClock initialized: now 1786031776183536 us; error 29 us; skew 500 ppm
I20260806 15:56:16.190272 17892 webserver.cc:460] Webserver started at http://127.10.189.193:40777/ using document root <none> and password file <none>
I20260806 15:56:16.190904 17892 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:16.190968 17892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:16.191140 17892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:16.193024 17892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "bae9a1c2cb214320a22f3f2a461effc1"
format_stamp: "Formatted at 2026-08-06 15:56:16 on dist-test-slave-mn4r"
I20260806 15:56:16.193529 17892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "bae9a1c2cb214320a22f3f2a461effc1"
format_stamp: "Formatted at 2026-08-06 15:56:16 on dist-test-slave-mn4r"
I20260806 15:56:16.197170 17892 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.002s
I20260806 15:56:16.199744 17906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:16.201035 17892 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 15:56:16.201166 17892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "bae9a1c2cb214320a22f3f2a461effc1"
format_stamp: "Formatted at 2026-08-06 15:56:16 on dist-test-slave-mn4r"
I20260806 15:56:16.201274 17892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:16.216573 17892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:16.217236 17892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:16.217427 17892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:16.218008 17892 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:16.218982 17892 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:16.219055 17892 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:16.219130 17892 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:16.219173 17892 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:16.228101 17892 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.193:43725
I20260806 15:56:16.228135 18021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.193:43725 every 8 connection(s)
I20260806 15:56:16.228989 17892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260806 15:56:16.231148 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 17892
I20260806 15:56:16.231262 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260806 15:56:16.233603 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.194:0
--local_ip_for_outbound_sockets=127.10.189.194
--webserver_interface=127.10.189.194
--webserver_port=0
--tserver_master_addrs=127.10.189.254:43133
--builtin_ntp_servers=127.10.189.212:42325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260806 15:56:16.240792 18022 heartbeater.cc:347] Connected to a master server at 127.10.189.254:43133
I20260806 15:56:16.241050 18022 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:16.241559 18022 heartbeater.cc:511] Master 127.10.189.254:43133 requested a full tablet report, sending...
I20260806 15:56:16.243309 17829 ts_manager.cc:194] Registered new tserver with Master: bae9a1c2cb214320a22f3f2a461effc1 (127.10.189.193:43725)
I20260806 15:56:16.245079 17829 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.193:44659
W20260806 15:56:16.345053 18025 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:56:16.345324 18025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:16.345345 18025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:16.345376 18025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:16.349268 18025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:16.349346 18025 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.194
I20260806 15:56:16.353972 18025 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:42325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.10.189.194
--webserver_port=0
--tserver_master_addrs=127.10.189.254:43133
--never_fsync=true
--heap_profile_path=/tmp/kudu.18025
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.194
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:16.355031 18025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:16.356423 18025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:16.365569 18030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:16.365562 18033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:16.365566 18031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:16.365805 18025 server_base.cc:1034] running on GCE node
I20260806 15:56:16.366324 18025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:16.366968 18025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:16.368131 18025 hybrid_clock.cc:648] HybridClock initialized: now 1786031776368116 us; error 24 us; skew 500 ppm
I20260806 15:56:16.369859 18025 webserver.cc:460] Webserver started at http://127.10.189.194:36891/ using document root <none> and password file <none>
I20260806 15:56:16.370491 18025 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:16.370580 18025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:16.370821 18025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:16.372673 18025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "6f1cfd4c85194df6965f23354d5531f6"
format_stamp: "Formatted at 2026-08-06 15:56:16 on dist-test-slave-mn4r"
I20260806 15:56:16.373225 18025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "6f1cfd4c85194df6965f23354d5531f6"
format_stamp: "Formatted at 2026-08-06 15:56:16 on dist-test-slave-mn4r"
I20260806 15:56:16.376924 18025 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260806 15:56:16.379416 18039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:16.380633 18025 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 15:56:16.380752 18025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "6f1cfd4c85194df6965f23354d5531f6"
format_stamp: "Formatted at 2026-08-06 15:56:16 on dist-test-slave-mn4r"
I20260806 15:56:16.380852 18025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:16.406260 18025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:16.406950 18025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:16.407115 18025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:16.407665 18025 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:16.408635 18025 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:16.408684 18025 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:16.408725 18025 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:16.408740 18025 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:16.417404 18025 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.194:35357
I20260806 15:56:16.417557 18156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.194:35357 every 8 connection(s)
I20260806 15:56:16.418494 18025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260806 15:56:16.420547 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 18025
I20260806 15:56:16.420686 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260806 15:56:16.423205 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.195:0
--local_ip_for_outbound_sockets=127.10.189.195
--webserver_interface=127.10.189.195
--webserver_port=0
--tserver_master_addrs=127.10.189.254:43133
--builtin_ntp_servers=127.10.189.212:42325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260806 15:56:16.430567 18157 heartbeater.cc:347] Connected to a master server at 127.10.189.254:43133
I20260806 15:56:16.430855 18157 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:16.431576 18157 heartbeater.cc:511] Master 127.10.189.254:43133 requested a full tablet report, sending...
I20260806 15:56:16.432735 17829 ts_manager.cc:194] Registered new tserver with Master: 6f1cfd4c85194df6965f23354d5531f6 (127.10.189.194:35357)
I20260806 15:56:16.433320 17829 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.194:59577
W20260806 15:56:16.537573 18160 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:56:16.537829 18160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:16.537849 18160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:16.537936 18160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:16.542363 18160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:16.542471 18160 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.195
I20260806 15:56:16.547168 18160 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:42325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.189.195
--webserver_port=0
--tserver_master_addrs=127.10.189.254:43133
--never_fsync=true
--heap_profile_path=/tmp/kudu.18160
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.195
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:16.548197 18160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:16.549563 18160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:16.558758 18168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:16.558750 18165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:16.558750 18166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:16.559156 18160 server_base.cc:1034] running on GCE node
I20260806 15:56:16.559571 18160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:16.560190 18160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:16.561370 18160 hybrid_clock.cc:648] HybridClock initialized: now 1786031776561348 us; error 35 us; skew 500 ppm
I20260806 15:56:16.563262 18160 webserver.cc:460] Webserver started at http://127.10.189.195:44983/ using document root <none> and password file <none>
I20260806 15:56:16.563838 18160 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:16.563930 18160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:16.564162 18160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:16.566186 18160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "4e0e3091435e4cf7985f319351b1d7c2"
format_stamp: "Formatted at 2026-08-06 15:56:16 on dist-test-slave-mn4r"
I20260806 15:56:16.567651 18160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "4e0e3091435e4cf7985f319351b1d7c2"
format_stamp: "Formatted at 2026-08-06 15:56:16 on dist-test-slave-mn4r"
I20260806 15:56:16.571375 18160 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 15:56:16.573838 18174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:16.575124 18160 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 15:56:16.575258 18160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "4e0e3091435e4cf7985f319351b1d7c2"
format_stamp: "Formatted at 2026-08-06 15:56:16 on dist-test-slave-mn4r"
I20260806 15:56:16.575367 18160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:16.595686 18160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:16.596366 18160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:16.596575 18160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:16.597142 18160 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:16.598122 18160 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:16.598199 18160 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:16.598272 18160 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:16.598315 18160 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:16.607339 18160 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.195:42957
I20260806 15:56:16.607365 18291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.195:42957 every 8 connection(s)
I20260806 15:56:16.608217 18160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260806 15:56:16.610769 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 18160
I20260806 15:56:16.610956 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260806 15:56:16.613276 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.196:0
--local_ip_for_outbound_sockets=127.10.189.196
--webserver_interface=127.10.189.196
--webserver_port=0
--tserver_master_addrs=127.10.189.254:43133
--builtin_ntp_servers=127.10.189.212:42325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260806 15:56:16.620134 18292 heartbeater.cc:347] Connected to a master server at 127.10.189.254:43133
I20260806 15:56:16.620378 18292 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:16.620882 18292 heartbeater.cc:511] Master 127.10.189.254:43133 requested a full tablet report, sending...
I20260806 15:56:16.621973 17829 ts_manager.cc:194] Registered new tserver with Master: 4e0e3091435e4cf7985f319351b1d7c2 (127.10.189.195:42957)
I20260806 15:56:16.622887 17829 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.195:41645
W20260806 15:56:16.726842 18296 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:56:16.727113 18296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:16.727133 18296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:16.727164 18296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:16.731204 18296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:16.731287 18296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.196
I20260806 15:56:16.735910 18296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:42325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.196:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.10.189.196
--webserver_port=0
--tserver_master_addrs=127.10.189.254:43133
--never_fsync=true
--heap_profile_path=/tmp/kudu.18296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.196
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:16.736975 18296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:16.738449 18296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:16.747958 18305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:16.748049 18296 server_base.cc:1034] running on GCE node
W20260806 15:56:16.747960 18303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:16.747960 18301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:16.748751 18296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:16.749383 18296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:16.750538 18296 hybrid_clock.cc:648] HybridClock initialized: now 1786031776750520 us; error 36 us; skew 500 ppm
I20260806 15:56:16.752378 18296 webserver.cc:460] Webserver started at http://127.10.189.196:39895/ using document root <none> and password file <none>
I20260806 15:56:16.752955 18296 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:16.753015 18296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:16.753261 18296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:16.755234 18296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "b7d067681f004623861916d81e00d13c"
format_stamp: "Formatted at 2026-08-06 15:56:16 on dist-test-slave-mn4r"
I20260806 15:56:16.755793 18296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "b7d067681f004623861916d81e00d13c"
format_stamp: "Formatted at 2026-08-06 15:56:16 on dist-test-slave-mn4r"
I20260806 15:56:16.759409 18296 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 15:56:16.761755 18311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:16.763074 18296 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 15:56:16.763211 18296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "b7d067681f004623861916d81e00d13c"
format_stamp: "Formatted at 2026-08-06 15:56:16 on dist-test-slave-mn4r"
I20260806 15:56:16.763316 18296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:16.780802 18296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:16.781467 18296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:16.781661 18296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:16.782305 18296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:16.783254 18296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:16.783325 18296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:16.783401 18296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:16.783443 18296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:16.793711 18296 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.196:42341
I20260806 15:56:16.793782 18427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.196:42341 every 8 connection(s)
I20260806 15:56:16.794667 18296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20260806 15:56:16.800420 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 18296
I20260806 15:56:16.800562 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20260806 15:56:16.802872 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.197:0
--local_ip_for_outbound_sockets=127.10.189.197
--webserver_interface=127.10.189.197
--webserver_port=0
--tserver_master_addrs=127.10.189.254:43133
--builtin_ntp_servers=127.10.189.212:42325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260806 15:56:16.805567 18428 heartbeater.cc:347] Connected to a master server at 127.10.189.254:43133
I20260806 15:56:16.805804 18428 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:16.806365 18428 heartbeater.cc:511] Master 127.10.189.254:43133 requested a full tablet report, sending...
I20260806 15:56:16.807547 17829 ts_manager.cc:194] Registered new tserver with Master: b7d067681f004623861916d81e00d13c (127.10.189.196:42341)
I20260806 15:56:16.808127 17829 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.196:54883
W20260806 15:56:16.918402 18431 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:56:16.918687 18431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:16.918728 18431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:16.918792 18431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:16.922981 18431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:16.923105 18431 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.197
I20260806 15:56:16.927716 18431 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:42325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.197:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.10.189.197
--webserver_port=0
--tserver_master_addrs=127.10.189.254:43133
--never_fsync=true
--heap_profile_path=/tmp/kudu.18431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.197
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:16.928778 18431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:16.930363 18431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:16.939962 18437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:16.940100 18431 server_base.cc:1034] running on GCE node
W20260806 15:56:16.939985 18436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:16.939957 18439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:16.940610 18431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:16.941253 18431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:16.942436 18431 hybrid_clock.cc:648] HybridClock initialized: now 1786031776942420 us; error 29 us; skew 500 ppm
I20260806 15:56:16.944236 18431 webserver.cc:460] Webserver started at http://127.10.189.197:36341/ using document root <none> and password file <none>
I20260806 15:56:16.944818 18431 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:16.944911 18431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:16.945151 18431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:16.947113 18431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "bce3f61a68964131957183a5a2ed85a6"
format_stamp: "Formatted at 2026-08-06 15:56:16 on dist-test-slave-mn4r"
I20260806 15:56:16.947664 18431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "bce3f61a68964131957183a5a2ed85a6"
format_stamp: "Formatted at 2026-08-06 15:56:16 on dist-test-slave-mn4r"
I20260806 15:56:16.951251 18431 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 15:56:16.953591 18446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:16.954785 18431 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 15:56:16.954916 18431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "bce3f61a68964131957183a5a2ed85a6"
format_stamp: "Formatted at 2026-08-06 15:56:16 on dist-test-slave-mn4r"
I20260806 15:56:16.955020 18431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:16.977373 18431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:16.978055 18431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:16.978330 18431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:16.978976 18431 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:16.979952 18431 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:16.980020 18431 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:16.980101 18431 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:16.980137 18431 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:16.989401 18431 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.197:46311
I20260806 15:56:16.989420 18565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.197:46311 every 8 connection(s)
I20260806 15:56:16.990540 18431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20260806 15:56:17.000329 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 18431
I20260806 15:56:17.000464 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20260806 15:56:17.000828 18566 heartbeater.cc:347] Connected to a master server at 127.10.189.254:43133
I20260806 15:56:17.001080 18566 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:17.001688 18566 heartbeater.cc:511] Master 127.10.189.254:43133 requested a full tablet report, sending...
I20260806 15:56:17.002825 17828 ts_manager.cc:194] Registered new tserver with Master: bce3f61a68964131957183a5a2ed85a6 (127.10.189.197:46311)
I20260806 15:56:17.003475 17828 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.197:49833
I20260806 15:56:17.014586 10999 external_mini_cluster.cc:930] 5 TS(s) registered with all masters
I20260806 15:56:17.023680 17828 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37794:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 5
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
W20260806 15:56:17.026644 17828 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 6 tablet servers would be needed, 5 are available. Consider bringing up more tablet servers.
I20260806 15:56:17.046736 18088 tablet_service.cc:1467] Processing CreateTablet for tablet c29c9607c86f4c44833c3b37c24154be (DEFAULT_TABLE table=TestTable [id=78d0a582470541c1855e5dd9212a3732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:17.046736 17955 tablet_service.cc:1467] Processing CreateTablet for tablet c29c9607c86f4c44833c3b37c24154be (DEFAULT_TABLE table=TestTable [id=78d0a582470541c1855e5dd9212a3732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:17.047889 18088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c29c9607c86f4c44833c3b37c24154be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:17.047889 17955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c29c9607c86f4c44833c3b37c24154be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:17.047508 18360 tablet_service.cc:1467] Processing CreateTablet for tablet c29c9607c86f4c44833c3b37c24154be (DEFAULT_TABLE table=TestTable [id=78d0a582470541c1855e5dd9212a3732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:17.048076 18495 tablet_service.cc:1467] Processing CreateTablet for tablet c29c9607c86f4c44833c3b37c24154be (DEFAULT_TABLE table=TestTable [id=78d0a582470541c1855e5dd9212a3732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:17.048514 18360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c29c9607c86f4c44833c3b37c24154be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:17.049010 18495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c29c9607c86f4c44833c3b37c24154be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:17.056137 18587 tablet_bootstrap.cc:492] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c: Bootstrap starting.
I20260806 15:56:17.056558 18589 tablet_bootstrap.cc:492] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6: Bootstrap starting.
I20260806 15:56:17.056828 18588 tablet_bootstrap.cc:492] T c29c9607c86f4c44833c3b37c24154be P bce3f61a68964131957183a5a2ed85a6: Bootstrap starting.
I20260806 15:56:17.058514 18589 tablet_bootstrap.cc:654] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:17.058539 18587 tablet_bootstrap.cc:654] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:17.059352 18589 log.cc:824] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:17.059350 18587 log.cc:824] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:17.059350 18224 tablet_service.cc:1467] Processing CreateTablet for tablet c29c9607c86f4c44833c3b37c24154be (DEFAULT_TABLE table=TestTable [id=78d0a582470541c1855e5dd9212a3732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:17.059859 18590 tablet_bootstrap.cc:492] T c29c9607c86f4c44833c3b37c24154be P bae9a1c2cb214320a22f3f2a461effc1: Bootstrap starting.
I20260806 15:56:17.060391 18224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c29c9607c86f4c44833c3b37c24154be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:17.061297 18587 tablet_bootstrap.cc:492] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c: No bootstrap required, opened a new log
I20260806 15:56:17.061477 18587 ts_tablet_manager.cc:1397] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 15:56:17.061959 18590 tablet_bootstrap.cc:654] T c29c9607c86f4c44833c3b37c24154be P bae9a1c2cb214320a22f3f2a461effc1: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:17.061991 18588 tablet_bootstrap.cc:654] T c29c9607c86f4c44833c3b37c24154be P bce3f61a68964131957183a5a2ed85a6: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:17.062768 18590 log.cc:824] T c29c9607c86f4c44833c3b37c24154be P bae9a1c2cb214320a22f3f2a461effc1: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:17.062783 18588 log.cc:824] T c29c9607c86f4c44833c3b37c24154be P bce3f61a68964131957183a5a2ed85a6: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:17.064797 18590 tablet_bootstrap.cc:492] T c29c9607c86f4c44833c3b37c24154be P bae9a1c2cb214320a22f3f2a461effc1: No bootstrap required, opened a new log
I20260806 15:56:17.064986 18588 tablet_bootstrap.cc:492] T c29c9607c86f4c44833c3b37c24154be P bce3f61a68964131957183a5a2ed85a6: No bootstrap required, opened a new log
I20260806 15:56:17.065056 18590 ts_tablet_manager.cc:1397] T c29c9607c86f4c44833c3b37c24154be P bae9a1c2cb214320a22f3f2a461effc1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.005s
I20260806 15:56:17.065168 18588 ts_tablet_manager.cc:1397] T c29c9607c86f4c44833c3b37c24154be P bce3f61a68964131957183a5a2ed85a6: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260806 15:56:17.067251 18587 raft_consensus.cc:348] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } }
I20260806 15:56:17.067520 18587 raft_consensus.cc:729] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7d067681f004623861916d81e00d13c, State: Initialized, Role: FOLLOWER
I20260806 15:56:17.067847 18587 consensus_queue.cc:260] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } }
I20260806 15:56:17.068984 18587 ts_tablet_manager.cc:1428] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s
I20260806 15:56:17.069149 18595 tablet_bootstrap.cc:492] T c29c9607c86f4c44833c3b37c24154be P 4e0e3091435e4cf7985f319351b1d7c2: Bootstrap starting.
I20260806 15:56:17.069315 18428 heartbeater.cc:503] Master 127.10.189.254:43133 was elected leader, sending a full tablet report...
I20260806 15:56:17.069653 18588 raft_consensus.cc:348] T c29c9607c86f4c44833c3b37c24154be P bce3f61a68964131957183a5a2ed85a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } }
I20260806 15:56:17.069903 18588 raft_consensus.cc:729] T c29c9607c86f4c44833c3b37c24154be P bce3f61a68964131957183a5a2ed85a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bce3f61a68964131957183a5a2ed85a6, State: Initialized, Role: FOLLOWER
I20260806 15:56:17.070884 18590 raft_consensus.cc:348] T c29c9607c86f4c44833c3b37c24154be P bae9a1c2cb214320a22f3f2a461effc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } }
I20260806 15:56:17.071142 18590 raft_consensus.cc:729] T c29c9607c86f4c44833c3b37c24154be P bae9a1c2cb214320a22f3f2a461effc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae9a1c2cb214320a22f3f2a461effc1, State: Initialized, Role: FOLLOWER
I20260806 15:56:17.071396 18595 tablet_bootstrap.cc:654] T c29c9607c86f4c44833c3b37c24154be P 4e0e3091435e4cf7985f319351b1d7c2: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:17.071623 18589 tablet_bootstrap.cc:492] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6: No bootstrap required, opened a new log
I20260806 15:56:17.071818 18589 ts_tablet_manager.cc:1397] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20260806 15:56:17.072225 18595 log.cc:824] T c29c9607c86f4c44833c3b37c24154be P 4e0e3091435e4cf7985f319351b1d7c2: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:17.071442 18590 consensus_queue.cc:260] T c29c9607c86f4c44833c3b37c24154be P bae9a1c2cb214320a22f3f2a461effc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } }
I20260806 15:56:17.072839 18588 consensus_queue.cc:260] T c29c9607c86f4c44833c3b37c24154be P bce3f61a68964131957183a5a2ed85a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } }
I20260806 15:56:17.073338 18590 ts_tablet_manager.cc:1428] T c29c9607c86f4c44833c3b37c24154be P bae9a1c2cb214320a22f3f2a461effc1: Time spent starting tablet: real 0.008s user 0.005s sys 0.001s
I20260806 15:56:17.073701 18022 heartbeater.cc:503] Master 127.10.189.254:43133 was elected leader, sending a full tablet report...
I20260806 15:56:17.073885 18588 ts_tablet_manager.cc:1428] T c29c9607c86f4c44833c3b37c24154be P bce3f61a68964131957183a5a2ed85a6: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260806 15:56:17.074268 18566 heartbeater.cc:503] Master 127.10.189.254:43133 was elected leader, sending a full tablet report...
I20260806 15:56:17.076124 18595 tablet_bootstrap.cc:492] T c29c9607c86f4c44833c3b37c24154be P 4e0e3091435e4cf7985f319351b1d7c2: No bootstrap required, opened a new log
I20260806 15:56:17.076349 18595 ts_tablet_manager.cc:1397] T c29c9607c86f4c44833c3b37c24154be P 4e0e3091435e4cf7985f319351b1d7c2: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 15:56:17.079530 18589 raft_consensus.cc:348] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } }
I20260806 15:56:17.079754 18589 raft_consensus.cc:729] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f1cfd4c85194df6965f23354d5531f6, State: Initialized, Role: FOLLOWER
I20260806 15:56:17.080070 18589 consensus_queue.cc:260] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } }
I20260806 15:56:17.080479 18595 raft_consensus.cc:348] T c29c9607c86f4c44833c3b37c24154be P 4e0e3091435e4cf7985f319351b1d7c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } }
I20260806 15:56:17.080749 18595 raft_consensus.cc:729] T c29c9607c86f4c44833c3b37c24154be P 4e0e3091435e4cf7985f319351b1d7c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e0e3091435e4cf7985f319351b1d7c2, State: Initialized, Role: FOLLOWER
I20260806 15:56:17.080892 18157 heartbeater.cc:503] Master 127.10.189.254:43133 was elected leader, sending a full tablet report...
I20260806 15:56:17.081076 18589 ts_tablet_manager.cc:1428] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6: Time spent starting tablet: real 0.009s user 0.003s sys 0.003s
I20260806 15:56:17.081028 18595 consensus_queue.cc:260] T c29c9607c86f4c44833c3b37c24154be P 4e0e3091435e4cf7985f319351b1d7c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } }
I20260806 15:56:17.081632 18292 heartbeater.cc:503] Master 127.10.189.254:43133 was elected leader, sending a full tablet report...
I20260806 15:56:17.081974 18595 ts_tablet_manager.cc:1428] T c29c9607c86f4c44833c3b37c24154be P 4e0e3091435e4cf7985f319351b1d7c2: Time spent starting tablet: real 0.006s user 0.000s sys 0.005s
I20260806 15:56:17.085078 10999 external_mini_cluster.cc:930] 5 TS(s) registered with all masters
I20260806 15:56:17.086587 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver bae9a1c2cb214320a22f3f2a461effc1 to finish bootstrapping
I20260806 15:56:17.092257 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 6f1cfd4c85194df6965f23354d5531f6 to finish bootstrapping
I20260806 15:56:17.097867 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 4e0e3091435e4cf7985f319351b1d7c2 to finish bootstrapping
I20260806 15:56:17.102923 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver b7d067681f004623861916d81e00d13c to finish bootstrapping
I20260806 15:56:17.108642 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver bce3f61a68964131957183a5a2ed85a6 to finish bootstrapping
W20260806 15:56:17.109586 18293 tablet.cc:2369] T c29c9607c86f4c44833c3b37c24154be P 4e0e3091435e4cf7985f319351b1d7c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:56:17.118953 18109 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c29c9607c86f4c44833c3b37c24154be"
dest_uuid: "6f1cfd4c85194df6965f23354d5531f6"
from {username='slave'} at 127.0.0.1:43144
I20260806 15:56:17.119213 18109 raft_consensus.cc:482] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:17.119359 18109 raft_consensus.cc:3037] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:17.120400 18109 raft_consensus.cc:504] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } }
I20260806 15:56:17.121616 18109 leader_election.cc:288] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [CANDIDATE]: Term 1 election: Requested vote from peers b7d067681f004623861916d81e00d13c (127.10.189.196:42341), bae9a1c2cb214320a22f3f2a461effc1 (127.10.189.193:43725), 4e0e3091435e4cf7985f319351b1d7c2 (127.10.189.195:42957), bce3f61a68964131957183a5a2ed85a6 (127.10.189.197:46311)
I20260806 15:56:17.127590 18516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c29c9607c86f4c44833c3b37c24154be" candidate_uuid: "6f1cfd4c85194df6965f23354d5531f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "bce3f61a68964131957183a5a2ed85a6"
I20260806 15:56:17.127630 18380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c29c9607c86f4c44833c3b37c24154be" candidate_uuid: "6f1cfd4c85194df6965f23354d5531f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b7d067681f004623861916d81e00d13c"
I20260806 15:56:17.127843 18516 raft_consensus.cc:3037] T c29c9607c86f4c44833c3b37c24154be P bce3f61a68964131957183a5a2ed85a6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:17.127859 18380 raft_consensus.cc:3037] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:17.127905 17976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c29c9607c86f4c44833c3b37c24154be" candidate_uuid: "6f1cfd4c85194df6965f23354d5531f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "bae9a1c2cb214320a22f3f2a461effc1"
I20260806 15:56:17.128103 17976 raft_consensus.cc:3037] T c29c9607c86f4c44833c3b37c24154be P bae9a1c2cb214320a22f3f2a461effc1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:17.129029 18380 raft_consensus.cc:2454] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f1cfd4c85194df6965f23354d5531f6 in term 1.
I20260806 15:56:17.129165 18516 raft_consensus.cc:2454] T c29c9607c86f4c44833c3b37c24154be P bce3f61a68964131957183a5a2ed85a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f1cfd4c85194df6965f23354d5531f6 in term 1.
I20260806 15:56:17.129351 17976 raft_consensus.cc:2454] T c29c9607c86f4c44833c3b37c24154be P bae9a1c2cb214320a22f3f2a461effc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f1cfd4c85194df6965f23354d5531f6 in term 1.
I20260806 15:56:17.129616 18042 leader_election.cc:302] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 6f1cfd4c85194df6965f23354d5531f6, b7d067681f004623861916d81e00d13c, bce3f61a68964131957183a5a2ed85a6; no voters:
I20260806 15:56:17.129954 18600 raft_consensus.cc:2781] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:17.130234 18600 raft_consensus.cc:686] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f1cfd4c85194df6965f23354d5531f6, State: Running, Role: LEADER
I20260806 15:56:17.130504 18244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c29c9607c86f4c44833c3b37c24154be" candidate_uuid: "6f1cfd4c85194df6965f23354d5531f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4e0e3091435e4cf7985f319351b1d7c2"
I20260806 15:56:17.130602 18600 consensus_queue.cc:237] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } }
I20260806 15:56:17.130707 18244 raft_consensus.cc:3037] T c29c9607c86f4c44833c3b37c24154be P 4e0e3091435e4cf7985f319351b1d7c2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:17.131767 18244 raft_consensus.cc:2454] T c29c9607c86f4c44833c3b37c24154be P 4e0e3091435e4cf7985f319351b1d7c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f1cfd4c85194df6965f23354d5531f6 in term 1.
I20260806 15:56:17.134614 17828 catalog_manager.cc:5495] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f1cfd4c85194df6965f23354d5531f6 (127.10.189.194). New cstate: current_term: 1 leader_uuid: "6f1cfd4c85194df6965f23354d5531f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } health_report { overall_health: UNKNOWN } } }
W20260806 15:56:17.169831 18158 tablet.cc:2369] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 15:56:17.230496 18023 tablet.cc:2369] T c29c9607c86f4c44833c3b37c24154be P bae9a1c2cb214320a22f3f2a461effc1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 15:56:17.241496 18567 tablet.cc:2369] T c29c9607c86f4c44833c3b37c24154be P bce3f61a68964131957183a5a2ed85a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 15:56:17.304430 18429 tablet.cc:2369] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:56:17.560695 18600 consensus_queue.cc:1035] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:56:17.634804 18600 consensus_queue.cc:1035] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:56:17.641350 18618 consensus_queue.cc:1035] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:56:17.642066 18614 consensus_queue.cc:1035] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:56:17.643927 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 17797
W20260806 15:56:17.652993 18176 connection.cc:535] client connection to 127.10.189.254:43133 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 15:56:17.653093 17908 connection.cc:535] client connection to 127.10.189.254:43133 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 15:56:17.653347 18292 heartbeater.cc:644] Failed to heartbeat to 127.10.189.254:43133 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 15:56:17.653362 18022 heartbeater.cc:644] Failed to heartbeat to 127.10.189.254:43133 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 15:56:17.653609 10999 raft_consensus_election-itest.cc:666] Removing tserver with uuid b7d067681f004623861916d81e00d13c
I20260806 15:56:17.655046 18109 consensus_queue.cc:237] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } }
I20260806 15:56:17.656440 18516 raft_consensus.cc:1261] T c29c9607c86f4c44833c3b37c24154be P bce3f61a68964131957183a5a2ed85a6 [term 1 FOLLOWER]: Refusing update from remote peer 6f1cfd4c85194df6965f23354d5531f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:56:17.656440 18244 raft_consensus.cc:1261] T c29c9607c86f4c44833c3b37c24154be P 4e0e3091435e4cf7985f319351b1d7c2 [term 1 FOLLOWER]: Refusing update from remote peer 6f1cfd4c85194df6965f23354d5531f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:56:17.656486 17976 raft_consensus.cc:1261] T c29c9607c86f4c44833c3b37c24154be P bae9a1c2cb214320a22f3f2a461effc1 [term 1 FOLLOWER]: Refusing update from remote peer 6f1cfd4c85194df6965f23354d5531f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:56:17.656885 18616 consensus_queue.cc:1035] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260806 15:56:17.657019 18614 consensus_queue.cc:1035] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260806 15:56:17.657124 18618 consensus_queue.cc:1035] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260806 15:56:17.659291 18614 raft_consensus.cc:2932] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER b7d067681f004623861916d81e00d13c (127.10.189.196) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } } }
I20260806 15:56:17.659729 18244 raft_consensus.cc:2932] T c29c9607c86f4c44833c3b37c24154be P 4e0e3091435e4cf7985f319351b1d7c2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER b7d067681f004623861916d81e00d13c (127.10.189.196) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } } }
I20260806 15:56:17.661926 17976 raft_consensus.cc:2932] T c29c9607c86f4c44833c3b37c24154be P bae9a1c2cb214320a22f3f2a461effc1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER b7d067681f004623861916d81e00d13c (127.10.189.196) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } } }
I20260806 15:56:17.662109 18516 raft_consensus.cc:2932] T c29c9607c86f4c44833c3b37c24154be P bce3f61a68964131957183a5a2ed85a6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER b7d067681f004623861916d81e00d13c (127.10.189.196) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } } }
W20260806 15:56:17.664708 18157 heartbeater.cc:644] Failed to heartbeat to 127.10.189.254:43133 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.189.254:43133: connect: Connection refused (error 111)
W20260806 15:56:17.664907 18566 heartbeater.cc:644] Failed to heartbeat to 127.10.189.254:43133 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.189.254:43133: connect: Connection refused (error 111)
I20260806 15:56:17.676312 10999 raft_consensus_election-itest.cc:676] Pausing 3 replicas...
I20260806 15:56:17.708827 10999 raft_consensus_election-itest.cc:684] Adding back Peer b7d067681f004623861916d81e00d13c and expecting timeout...
I20260806 15:56:17.710230 18109 consensus_queue.cc:237] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } attrs { } }
I20260806 15:56:17.711796 18380 raft_consensus.cc:1261] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [term 1 FOLLOWER]: Refusing update from remote peer 6f1cfd4c85194df6965f23354d5531f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260806 15:56:17.712225 18618 consensus_queue.cc:1035] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } attrs { }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260806 15:56:17.713758 18380 raft_consensus.cc:858] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } }.
Pending config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } }:
New config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } attrs { } }
W20260806 15:56:17.713831 18380 raft_consensus.cc:1565] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 3' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } }.
Pending config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } }:
New config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } attrs { } }
I20260806 15:56:17.714241 18380 raft_consensus.cc:2932] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER b7d067681f004623861916d81e00d13c (127.10.189.196) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } } }
I20260806 15:56:17.716552 18380 raft_consensus.cc:1467] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [term 1 NON_PARTICIPANT]: Allowing update even though not a member of the config
W20260806 15:56:17.716840 18428 heartbeater.cc:644] Failed to heartbeat to 127.10.189.254:43133 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.189.254:43133: connect: Connection refused (error 111)
I20260806 15:56:17.810164 10999 raft_consensus_election-itest.cc:688] Timeout achieved.
I20260806 15:56:17.816435 10999 raft_consensus_election-itest.cc:699] Forcing Peer 6f1cfd4c85194df6965f23354d5531f6 to step down...
I20260806 15:56:17.816965 18109 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c29c9607c86f4c44833c3b37c24154be"
dest_uuid: "6f1cfd4c85194df6965f23354d5531f6"
from {username='slave'} at 127.0.0.1:43144
I20260806 15:56:17.817164 18109 raft_consensus.cc:580] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [term 1 LEADER]: Received request to step down
I20260806 15:56:17.817258 18109 raft_consensus.cc:3032] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260806 15:56:17.817302 18109 raft_consensus.cc:729] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f1cfd4c85194df6965f23354d5531f6, State: Running, Role: LEADER
I20260806 15:56:17.817468 18109 consensus_queue.cc:260] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } attrs { } }
I20260806 15:56:17.817672 18109 raft_consensus.cc:3037] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:17.818133 10999 raft_consensus_election-itest.cc:705] Resuming Peer bae9a1c2cb214320a22f3f2a461effc1 ...
I20260806 15:56:17.819387 17976 raft_consensus.cc:1261] T c29c9607c86f4c44833c3b37c24154be P bae9a1c2cb214320a22f3f2a461effc1 [term 1 FOLLOWER]: Refusing update from remote peer 6f1cfd4c85194df6965f23354d5531f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260806 15:56:17.819448 10999 raft_consensus_election-itest.cc:710] Trying to elect Peer b7d067681f004623861916d81e00d13c ...
I20260806 15:56:17.819859 18380 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c29c9607c86f4c44833c3b37c24154be"
dest_uuid: "b7d067681f004623861916d81e00d13c"
from {username='slave'} at 127.0.0.1:52434
I20260806 15:56:17.820055 18380 raft_consensus.cc:482] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:17.820147 18380 raft_consensus.cc:3037] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:17.821040 18380 raft_consensus.cc:504] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } attrs { } }
I20260806 15:56:17.822244 18380 leader_election.cc:288] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [CANDIDATE]: Term 2 election: Requested vote from peers 6f1cfd4c85194df6965f23354d5531f6 (127.10.189.194:35357), bae9a1c2cb214320a22f3f2a461effc1 (127.10.189.193:43725), 4e0e3091435e4cf7985f319351b1d7c2 (127.10.189.195:42957), bce3f61a68964131957183a5a2ed85a6 (127.10.189.197:46311)
I20260806 15:56:17.824486 10999 cluster_itest_util.cc:256] Not converged past 4 yet: 1.2 1.3 1.3
I20260806 15:56:17.827054 18109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c29c9607c86f4c44833c3b37c24154be" candidate_uuid: "b7d067681f004623861916d81e00d13c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "6f1cfd4c85194df6965f23354d5531f6"
I20260806 15:56:17.827292 17976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c29c9607c86f4c44833c3b37c24154be" candidate_uuid: "b7d067681f004623861916d81e00d13c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "bae9a1c2cb214320a22f3f2a461effc1"
I20260806 15:56:17.827419 17976 raft_consensus.cc:1799] T c29c9607c86f4c44833c3b37c24154be P bae9a1c2cb214320a22f3f2a461effc1 [term 1 FOLLOWER]: Handling vote request from an unknown peer b7d067681f004623861916d81e00d13c
I20260806 15:56:17.827479 17976 raft_consensus.cc:3037] T c29c9607c86f4c44833c3b37c24154be P bae9a1c2cb214320a22f3f2a461effc1 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:17.828135 18109 raft_consensus.cc:2454] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7d067681f004623861916d81e00d13c in term 2.
I20260806 15:56:17.828346 17976 raft_consensus.cc:2454] T c29c9607c86f4c44833c3b37c24154be P bae9a1c2cb214320a22f3f2a461effc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7d067681f004623861916d81e00d13c in term 2.
I20260806 15:56:17.828645 18312 leader_election.cc:302] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 6f1cfd4c85194df6965f23354d5531f6, b7d067681f004623861916d81e00d13c, bae9a1c2cb214320a22f3f2a461effc1; no voters:
I20260806 15:56:17.828871 18612 raft_consensus.cc:2781] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [term 2 FOLLOWER]: Leader election won for term 2
I20260806 15:56:17.829041 18612 raft_consensus.cc:686] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [term 2 LEADER]: Becoming Leader. State: Replica: b7d067681f004623861916d81e00d13c, State: Running, Role: LEADER
I20260806 15:56:17.829391 18612 consensus_queue.cc:237] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } attrs { } }
I20260806 15:56:17.927568 10999 cluster_itest_util.cc:256] Not converged past 4 yet: 1.2 1.3 2.4
I20260806 15:56:18.130728 10999 cluster_itest_util.cc:256] Not converged past 4 yet: 1.2 1.3 2.4
I20260806 15:56:18.298396 17976 raft_consensus.cc:1261] T c29c9607c86f4c44833c3b37c24154be P bae9a1c2cb214320a22f3f2a461effc1 [term 2 FOLLOWER]: Refusing update from remote peer b7d067681f004623861916d81e00d13c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260806 15:56:18.298955 18612 consensus_queue.cc:1035] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260806 15:56:18.306725 18109 raft_consensus.cc:1261] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [term 2 FOLLOWER]: Refusing update from remote peer b7d067681f004623861916d81e00d13c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260806 15:56:18.307389 18612 consensus_queue.cc:1035] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260806 15:56:18.309310 18641 raft_consensus.cc:2932] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [term 2 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER b7d067681f004623861916d81e00d13c (127.10.189.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } attrs { } } }
I20260806 15:56:18.309767 18109 raft_consensus.cc:2932] T c29c9607c86f4c44833c3b37c24154be P 6f1cfd4c85194df6965f23354d5531f6 [term 2 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER b7d067681f004623861916d81e00d13c (127.10.189.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } attrs { } } }
W20260806 15:56:18.311050 18109 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43144 (request call id 51) took 601 ms (client timeout 100 ms). Trace:
I20260806 15:56:18.311815 17976 raft_consensus.cc:2932] T c29c9607c86f4c44833c3b37c24154be P bae9a1c2cb214320a22f3f2a461effc1 [term 2 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER b7d067681f004623861916d81e00d13c (127.10.189.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } attrs { } } }
W20260806 15:56:18.311169 18109 rpcz_store.cc:269] 0806 15:56:17.709570 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:56:17.709651 (+ 81us) service_pool.cc:227] Handling call
0806 15:56:17.710909 (+ 1258us) log.cc:842] Serialized 618 byte log entry
0806 15:56:18.311023 (+600114us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":356,"raft.run_cpu_time_us":647,"raft.run_wall_time_us":829,"spinlock_wait_cycles":811008}
I20260806 15:56:18.433833 10999 raft_consensus_election-itest.cc:716] Resuming remaining nodes...
I20260806 15:56:18.435915 18516 raft_consensus.cc:1261] T c29c9607c86f4c44833c3b37c24154be P bce3f61a68964131957183a5a2ed85a6 [term 1 FOLLOWER]: Refusing update from remote peer 6f1cfd4c85194df6965f23354d5531f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260806 15:56:18.436345 18244 raft_consensus.cc:1261] T c29c9607c86f4c44833c3b37c24154be P 4e0e3091435e4cf7985f319351b1d7c2 [term 1 FOLLOWER]: Refusing update from remote peer 6f1cfd4c85194df6965f23354d5531f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260806 15:56:18.441000 18243 raft_consensus.cc:3037] T c29c9607c86f4c44833c3b37c24154be P 4e0e3091435e4cf7985f319351b1d7c2 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:18.441727 18515 raft_consensus.cc:3037] T c29c9607c86f4c44833c3b37c24154be P bce3f61a68964131957183a5a2ed85a6 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:18.442200 18244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c29c9607c86f4c44833c3b37c24154be" candidate_uuid: "b7d067681f004623861916d81e00d13c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "4e0e3091435e4cf7985f319351b1d7c2"
I20260806 15:56:18.442385 18243 raft_consensus.cc:1261] T c29c9607c86f4c44833c3b37c24154be P 4e0e3091435e4cf7985f319351b1d7c2 [term 2 FOLLOWER]: Refusing update from remote peer b7d067681f004623861916d81e00d13c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260806 15:56:18.442487 18516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c29c9607c86f4c44833c3b37c24154be" candidate_uuid: "b7d067681f004623861916d81e00d13c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "bce3f61a68964131957183a5a2ed85a6"
I20260806 15:56:18.442831 18244 raft_consensus.cc:1799] T c29c9607c86f4c44833c3b37c24154be P 4e0e3091435e4cf7985f319351b1d7c2 [term 2 FOLLOWER]: Handling vote request from an unknown peer b7d067681f004623861916d81e00d13c
I20260806 15:56:18.442958 18515 raft_consensus.cc:1261] T c29c9607c86f4c44833c3b37c24154be P bce3f61a68964131957183a5a2ed85a6 [term 2 FOLLOWER]: Refusing update from remote peer b7d067681f004623861916d81e00d13c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260806 15:56:18.443352 18516 raft_consensus.cc:1799] T c29c9607c86f4c44833c3b37c24154be P bce3f61a68964131957183a5a2ed85a6 [term 2 FOLLOWER]: Handling vote request from an unknown peer b7d067681f004623861916d81e00d13c
I20260806 15:56:18.443744 18244 raft_consensus.cc:2454] T c29c9607c86f4c44833c3b37c24154be P 4e0e3091435e4cf7985f319351b1d7c2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7d067681f004623861916d81e00d13c in term 2.
I20260806 15:56:18.444180 18648 consensus_queue.cc:1035] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260806 15:56:18.444257 18516 raft_consensus.cc:2454] T c29c9607c86f4c44833c3b37c24154be P bce3f61a68964131957183a5a2ed85a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7d067681f004623861916d81e00d13c in term 2.
I20260806 15:56:18.444841 18647 consensus_queue.cc:1035] T c29c9607c86f4c44833c3b37c24154be P b7d067681f004623861916d81e00d13c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260806 15:56:18.447058 18244 raft_consensus.cc:2932] T c29c9607c86f4c44833c3b37c24154be P 4e0e3091435e4cf7985f319351b1d7c2 [term 2 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER b7d067681f004623861916d81e00d13c (127.10.189.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } attrs { } } }
I20260806 15:56:18.447299 18516 raft_consensus.cc:2932] T c29c9607c86f4c44833c3b37c24154be P bce3f61a68964131957183a5a2ed85a6 [term 2 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER b7d067681f004623861916d81e00d13c (127.10.189.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f1cfd4c85194df6965f23354d5531f6" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35357 } } peers { permanent_uuid: "bae9a1c2cb214320a22f3f2a461effc1" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 43725 } } peers { permanent_uuid: "4e0e3091435e4cf7985f319351b1d7c2" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 42957 } } peers { permanent_uuid: "bce3f61a68964131957183a5a2ed85a6" member_type: VOTER last_known_addr { host: "127.10.189.197" port: 46311 } } peers { permanent_uuid: "b7d067681f004623861916d81e00d13c" member_type: VOTER last_known_addr { host: "127.10.189.196" port: 42341 } attrs { } } }
I20260806 15:56:18.453269 18655 mvcc.cc:205] Tried to move back new op lower bound from 7315586164493299712 to 7315586161993363456. Current Snapshot: MvccSnapshot[applied={T|T < 7315586164493299712}]
I20260806 15:56:18.453413 18656 mvcc.cc:205] Tried to move back new op lower bound from 7315586164493299712 to 7315586161993363456. Current Snapshot: MvccSnapshot[applied={T|T < 7315586164493299712}]
I20260806 15:56:18.457649 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 17892
I20260806 15:56:18.464771 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 18025
I20260806 15:56:18.471524 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 18160
I20260806 15:56:18.477762 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 18296
I20260806 15:56:18.483853 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 18431
2026-08-06T15:56:18Z chronyd exiting
[ OK ] RaftConsensusElectionITest.ElectPendingVoter (2703 ms)
[ RUN ] RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy
I20260806 15:56:18.507072 10999 test_util.cc:268] Using random seed: -306763461
I20260806 15:56:18.507893 10999 ts_itest-base.cc:112] Starting cluster with:
I20260806 15:56:18.507931 10999 ts_itest-base.cc:113] --------------
I20260806 15:56:18.507943 10999 ts_itest-base.cc:114] 3 tablet servers
I20260806 15:56:18.507954 10999 ts_itest-base.cc:115] 3 replicas per TS
I20260806 15:56:18.507964 10999 ts_itest-base.cc:116] --------------
2026-08-06T15:56:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:56:18Z Disabled control of system clock
I20260806 15:56:18.517374 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:42685
--webserver_interface=127.10.189.254
--webserver_port=0
--builtin_ntp_servers=127.10.189.212:40229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.189.254:42685
--master_add_server_when_underreplicated=false
--raft_prepare_replacement_before_eviction=false with env {}
W20260806 15:56:18.626684 18676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:18.626976 18676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:18.627065 18676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:18.631057 18676 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260806 15:56:18.631135 18676 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:56:18.631202 18676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:18.631259 18676 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:56:18.631294 18676 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:56:18.636034 18676 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:40229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--master_add_server_when_underreplicated=false
--ipki_ca_key_size=768
--master_addresses=127.10.189.254:42685
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:42685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.10.189.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.18676
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:18.637126 18676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:18.638609 18676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:18.647089 18682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:18.647148 18683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:18.647250 18685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:18.647306 18676 server_base.cc:1034] running on GCE node
I20260806 15:56:18.648005 18676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:18.649009 18676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:18.650161 18676 hybrid_clock.cc:648] HybridClock initialized: now 1786031778650131 us; error 43 us; skew 500 ppm
I20260806 15:56:18.651993 18676 webserver.cc:460] Webserver started at http://127.10.189.254:37263/ using document root <none> and password file <none>
I20260806 15:56:18.652587 18676 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:18.652648 18676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:18.652812 18676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:18.654731 18676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "3225fe33f44e49f8ae6de7fd9d93407d"
format_stamp: "Formatted at 2026-08-06 15:56:18 on dist-test-slave-mn4r"
I20260806 15:56:18.655228 18676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "3225fe33f44e49f8ae6de7fd9d93407d"
format_stamp: "Formatted at 2026-08-06 15:56:18 on dist-test-slave-mn4r"
I20260806 15:56:18.658802 18676 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 15:56:18.661100 18691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:18.662426 18676 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 15:56:18.662571 18676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
uuid: "3225fe33f44e49f8ae6de7fd9d93407d"
format_stamp: "Formatted at 2026-08-06 15:56:18 on dist-test-slave-mn4r"
I20260806 15:56:18.662679 18676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:18.687206 18676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:18.687927 18676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:18.688143 18676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:18.695555 18676 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.254:42685
I20260806 15:56:18.695576 18744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.254:42685 every 8 connection(s)
I20260806 15:56:18.696502 18676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260806 15:56:18.699846 18745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:18.702965 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 18676
I20260806 15:56:18.703109 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260806 15:56:18.705392 18745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d: Bootstrap starting.
I20260806 15:56:18.707828 18745 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:18.708716 18745 log.cc:824] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:18.710573 18745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d: No bootstrap required, opened a new log
I20260806 15:56:18.715103 18745 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3225fe33f44e49f8ae6de7fd9d93407d" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42685 } }
I20260806 15:56:18.715345 18745 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:56:18.715425 18745 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3225fe33f44e49f8ae6de7fd9d93407d, State: Initialized, Role: FOLLOWER
I20260806 15:56:18.715907 18745 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3225fe33f44e49f8ae6de7fd9d93407d" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42685 } }
I20260806 15:56:18.716080 18745 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:56:18.716156 18745 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:56:18.716257 18745 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:18.717583 18745 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3225fe33f44e49f8ae6de7fd9d93407d" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42685 } }
I20260806 15:56:18.717971 18745 leader_election.cc:302] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3225fe33f44e49f8ae6de7fd9d93407d; no voters:
I20260806 15:56:18.718310 18745 leader_election.cc:288] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:56:18.718408 18751 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:18.718678 18751 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [term 1 LEADER]: Becoming Leader. State: Replica: 3225fe33f44e49f8ae6de7fd9d93407d, State: Running, Role: LEADER
I20260806 15:56:18.719022 18751 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3225fe33f44e49f8ae6de7fd9d93407d" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42685 } }
I20260806 15:56:18.719564 18745 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:56:18.720769 18752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3225fe33f44e49f8ae6de7fd9d93407d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3225fe33f44e49f8ae6de7fd9d93407d" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42685 } } }
I20260806 15:56:18.720774 18753 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3225fe33f44e49f8ae6de7fd9d93407d. Latest consensus state: current_term: 1 leader_uuid: "3225fe33f44e49f8ae6de7fd9d93407d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3225fe33f44e49f8ae6de7fd9d93407d" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42685 } } }
I20260806 15:56:18.721028 18752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [sys.catalog]: This master's current role is: LEADER
I20260806 15:56:18.721066 18753 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [sys.catalog]: This master's current role is: LEADER
I20260806 15:56:18.721612 18762 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:56:18.724535 18762 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:56:18.729862 18762 catalog_manager.cc:1347] Generated new cluster ID: c293dd9ed801424aa0eb63dcfe955757
I20260806 15:56:18.729934 18762 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:56:18.764923 18762 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:56:18.765936 18762 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:56:18.772436 18762 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d: Generated new TSK 0
I20260806 15:56:18.773195 18762 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:56:18.780110 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.193:0
--local_ip_for_outbound_sockets=127.10.189.193
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42685
--builtin_ntp_servers=127.10.189.212:40229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
W20260806 15:56:18.895720 18771 flags.cc:425] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20260806 15:56:18.896063 18771 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:18.896118 18771 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:18.896185 18771 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:18.900219 18771 flags.cc:425] Enabled experimental flag: --log_compression_codec=no_compression
W20260806 15:56:18.900292 18771 flags.cc:425] Enabled experimental flag: --log_max_segments_to_retain=3
W20260806 15:56:18.900337 18771 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260806 15:56:18.900403 18771 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:18.900516 18771 flags.cc:425] Enabled experimental flag: --log_target_replay_size_mb=1
W20260806 15:56:18.900569 18771 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.193
I20260806 15:56:18.905323 18771 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:40229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42685
--never_fsync=true
--heap_profile_path=/tmp/kudu.18771
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.193
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:18.906612 18771 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:18.908039 18771 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:18.917542 18781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:18.917562 18779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:18.917562 18778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:18.917837 18771 server_base.cc:1034] running on GCE node
I20260806 15:56:18.918329 18771 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:18.918941 18771 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:18.920120 18771 hybrid_clock.cc:648] HybridClock initialized: now 1786031778920108 us; error 32 us; skew 500 ppm
I20260806 15:56:18.922005 18771 webserver.cc:460] Webserver started at http://127.10.189.193:36465/ using document root <none> and password file <none>
I20260806 15:56:18.922592 18771 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:18.922684 18771 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:18.922919 18771 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:18.924754 18771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "940a8a11d092473a97863482fd7b5c88"
format_stamp: "Formatted at 2026-08-06 15:56:18 on dist-test-slave-mn4r"
I20260806 15:56:18.925305 18771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "940a8a11d092473a97863482fd7b5c88"
format_stamp: "Formatted at 2026-08-06 15:56:18 on dist-test-slave-mn4r"
I20260806 15:56:18.928829 18771 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260806 15:56:18.931084 18787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:18.932242 18771 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 15:56:18.932382 18771 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "940a8a11d092473a97863482fd7b5c88"
format_stamp: "Formatted at 2026-08-06 15:56:18 on dist-test-slave-mn4r"
I20260806 15:56:18.932487 18771 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:18.945684 18771 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:18.946368 18771 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:18.946581 18771 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:18.947098 18771 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:18.948000 18771 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:18.948050 18771 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:18.948093 18771 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:18.948115 18771 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:18.956652 18771 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.193:35469
I20260806 15:56:18.956669 18903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.193:35469 every 8 connection(s)
I20260806 15:56:18.957559 18771 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260806 15:56:18.966974 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 18771
I20260806 15:56:18.967096 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260806 15:56:18.968128 18904 heartbeater.cc:347] Connected to a master server at 127.10.189.254:42685
I20260806 15:56:18.968370 18904 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:18.968874 18904 heartbeater.cc:511] Master 127.10.189.254:42685 requested a full tablet report, sending...
I20260806 15:56:18.969328 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.194:0
--local_ip_for_outbound_sockets=127.10.189.194
--webserver_interface=127.10.189.194
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42685
--builtin_ntp_servers=127.10.189.212:40229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20260806 15:56:18.970486 18702 ts_manager.cc:194] Registered new tserver with Master: 940a8a11d092473a97863482fd7b5c88 (127.10.189.193:35469)
I20260806 15:56:18.971722 18702 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.193:33851
W20260806 15:56:19.079937 18907 flags.cc:425] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20260806 15:56:19.080329 18907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:19.080399 18907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:19.080466 18907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:19.084618 18907 flags.cc:425] Enabled experimental flag: --log_compression_codec=no_compression
W20260806 15:56:19.084707 18907 flags.cc:425] Enabled experimental flag: --log_max_segments_to_retain=3
W20260806 15:56:19.084748 18907 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260806 15:56:19.084815 18907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:19.084919 18907 flags.cc:425] Enabled experimental flag: --log_target_replay_size_mb=1
W20260806 15:56:19.084978 18907 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.194
I20260806 15:56:19.089891 18907 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:40229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.10.189.194
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42685
--never_fsync=true
--heap_profile_path=/tmp/kudu.18907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.194
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:19.091090 18907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:19.092795 18907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:19.102762 18913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:19.102763 18914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:19.102856 18907 server_base.cc:1034] running on GCE node
W20260806 15:56:19.102792 18916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:19.103454 18907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:19.104110 18907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:19.105271 18907 hybrid_clock.cc:648] HybridClock initialized: now 1786031779105254 us; error 30 us; skew 500 ppm
I20260806 15:56:19.107231 18907 webserver.cc:460] Webserver started at http://127.10.189.194:44761/ using document root <none> and password file <none>
I20260806 15:56:19.107784 18907 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:19.107846 18907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:19.108012 18907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:19.110155 18907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "ce2255c97cc240d79310c0e7e4a3d736"
format_stamp: "Formatted at 2026-08-06 15:56:19 on dist-test-slave-mn4r"
I20260806 15:56:19.110710 18907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "ce2255c97cc240d79310c0e7e4a3d736"
format_stamp: "Formatted at 2026-08-06 15:56:19 on dist-test-slave-mn4r"
I20260806 15:56:19.114630 18907 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260806 15:56:19.117069 18922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:19.118373 18907 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 15:56:19.118489 18907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "ce2255c97cc240d79310c0e7e4a3d736"
format_stamp: "Formatted at 2026-08-06 15:56:19 on dist-test-slave-mn4r"
I20260806 15:56:19.118593 18907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:19.131891 18907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:19.132575 18907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:19.132773 18907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:19.133384 18907 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:19.134397 18907 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:19.134445 18907 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:19.134509 18907 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:19.134548 18907 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:19.143751 18907 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.194:39589
I20260806 15:56:19.143777 19037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.194:39589 every 8 connection(s)
I20260806 15:56:19.144687 18907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260806 15:56:19.146325 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 18907
I20260806 15:56:19.146464 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260806 15:56:19.148980 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.195:0
--local_ip_for_outbound_sockets=127.10.189.195
--webserver_interface=127.10.189.195
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42685
--builtin_ntp_servers=127.10.189.212:40229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20260806 15:56:19.156754 19038 heartbeater.cc:347] Connected to a master server at 127.10.189.254:42685
I20260806 15:56:19.157079 19038 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:19.157609 19038 heartbeater.cc:511] Master 127.10.189.254:42685 requested a full tablet report, sending...
I20260806 15:56:19.158808 18702 ts_manager.cc:194] Registered new tserver with Master: ce2255c97cc240d79310c0e7e4a3d736 (127.10.189.194:39589)
I20260806 15:56:19.159495 18702 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.194:53613
W20260806 15:56:19.268725 19042 flags.cc:425] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20260806 15:56:19.269090 19042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:19.269150 19042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:19.269223 19042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:19.273301 19042 flags.cc:425] Enabled experimental flag: --log_compression_codec=no_compression
W20260806 15:56:19.273393 19042 flags.cc:425] Enabled experimental flag: --log_max_segments_to_retain=3
W20260806 15:56:19.273439 19042 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260806 15:56:19.273504 19042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:19.273599 19042 flags.cc:425] Enabled experimental flag: --log_target_replay_size_mb=1
W20260806 15:56:19.273650 19042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.195
I20260806 15:56:19.278610 19042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:40229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.189.195
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42685
--never_fsync=true
--heap_profile_path=/tmp/kudu.19042
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.195
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:19.279773 19042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:19.281255 19042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:19.290863 19047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:19.290904 19048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:19.290874 19050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:19.291230 19042 server_base.cc:1034] running on GCE node
I20260806 15:56:19.291637 19042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:19.292243 19042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:19.293428 19042 hybrid_clock.cc:648] HybridClock initialized: now 1786031779293411 us; error 32 us; skew 500 ppm
I20260806 15:56:19.295375 19042 webserver.cc:460] Webserver started at http://127.10.189.195:41027/ using document root <none> and password file <none>
I20260806 15:56:19.295986 19042 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:19.296097 19042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:19.296337 19042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:19.298331 19042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "b841735cb31d47e8900ce596c78170a9"
format_stamp: "Formatted at 2026-08-06 15:56:19 on dist-test-slave-mn4r"
I20260806 15:56:19.298965 19042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "b841735cb31d47e8900ce596c78170a9"
format_stamp: "Formatted at 2026-08-06 15:56:19 on dist-test-slave-mn4r"
I20260806 15:56:19.302690 19042 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 15:56:19.305094 19057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:19.306370 19042 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 15:56:19.306499 19042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "b841735cb31d47e8900ce596c78170a9"
format_stamp: "Formatted at 2026-08-06 15:56:19 on dist-test-slave-mn4r"
I20260806 15:56:19.306607 19042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:19.348832 19042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:19.349714 19042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:19.349972 19042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:19.350852 19042 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:19.352259 19042 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:19.352339 19042 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:19.352402 19042 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:19.352438 19042 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:19.362850 19042 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.195:39283
I20260806 15:56:19.362989 19173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.195:39283 every 8 connection(s)
I20260806 15:56:19.363888 19042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260806 15:56:19.367272 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 19042
I20260806 15:56:19.367409 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260806 15:56:19.374969 19174 heartbeater.cc:347] Connected to a master server at 127.10.189.254:42685
I20260806 15:56:19.375216 19174 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:19.375658 19174 heartbeater.cc:511] Master 127.10.189.254:42685 requested a full tablet report, sending...
I20260806 15:56:19.376605 18702 ts_manager.cc:194] Registered new tserver with Master: b841735cb31d47e8900ce596c78170a9 (127.10.189.195:39283)
I20260806 15:56:19.377182 18702 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.195:48735
I20260806 15:56:19.381683 10999 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:56:19.390887 18702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51438:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20260806 15:56:19.411099 19105 tablet_service.cc:1467] Processing CreateTablet for tablet 92b8ffc23a3342c5b86aa46d4706813d (DEFAULT_TABLE table=TestTable [id=4a1cc96af9d5417f8ffa74431d47e7f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:19.412083 19105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92b8ffc23a3342c5b86aa46d4706813d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:19.411696 18971 tablet_service.cc:1467] Processing CreateTablet for tablet 92b8ffc23a3342c5b86aa46d4706813d (DEFAULT_TABLE table=TestTable [id=4a1cc96af9d5417f8ffa74431d47e7f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:19.411696 18835 tablet_service.cc:1467] Processing CreateTablet for tablet 92b8ffc23a3342c5b86aa46d4706813d (DEFAULT_TABLE table=TestTable [id=4a1cc96af9d5417f8ffa74431d47e7f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:19.412770 18971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92b8ffc23a3342c5b86aa46d4706813d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:19.412771 18835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92b8ffc23a3342c5b86aa46d4706813d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:19.418478 19191 tablet_bootstrap.cc:492] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9: Bootstrap starting.
I20260806 15:56:19.420085 19192 tablet_bootstrap.cc:492] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88: Bootstrap starting.
I20260806 15:56:19.420861 19191 tablet_bootstrap.cc:654] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:19.421687 19191 log.cc:824] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:19.422127 19192 tablet_bootstrap.cc:654] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:19.422451 19193 tablet_bootstrap.cc:492] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: Bootstrap starting.
I20260806 15:56:19.422943 19192 log.cc:824] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:19.423827 19191 tablet_bootstrap.cc:492] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9: No bootstrap required, opened a new log
I20260806 15:56:19.424029 19191 ts_tablet_manager.cc:1397] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260806 15:56:19.424600 19193 tablet_bootstrap.cc:654] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:19.424875 19192 tablet_bootstrap.cc:492] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88: No bootstrap required, opened a new log
I20260806 15:56:19.425079 19192 ts_tablet_manager.cc:1397] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260806 15:56:19.425359 19193 log.cc:824] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:19.427165 19193 tablet_bootstrap.cc:492] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: No bootstrap required, opened a new log
I20260806 15:56:19.427374 19193 ts_tablet_manager.cc:1397] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260806 15:56:19.428704 19191 raft_consensus.cc:348] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } }
I20260806 15:56:19.428987 19191 raft_consensus.cc:374] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:56:19.429049 19191 raft_consensus.cc:729] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b841735cb31d47e8900ce596c78170a9, State: Initialized, Role: FOLLOWER
I20260806 15:56:19.429519 19191 consensus_queue.cc:260] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } }
I20260806 15:56:19.429433 19192 raft_consensus.cc:348] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } }
I20260806 15:56:19.429678 19192 raft_consensus.cc:374] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:56:19.429744 19192 raft_consensus.cc:729] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 940a8a11d092473a97863482fd7b5c88, State: Initialized, Role: FOLLOWER
I20260806 15:56:19.430248 19174 heartbeater.cc:503] Master 127.10.189.254:42685 was elected leader, sending a full tablet report...
I20260806 15:56:19.430261 19192 consensus_queue.cc:260] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } }
I20260806 15:56:19.430665 19191 ts_tablet_manager.cc:1428] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9: Time spent starting tablet: real 0.007s user 0.004s sys 0.003s
I20260806 15:56:19.431116 18904 heartbeater.cc:503] Master 127.10.189.254:42685 was elected leader, sending a full tablet report...
I20260806 15:56:19.432292 19192 ts_tablet_manager.cc:1428] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 15:56:19.433095 19193 raft_consensus.cc:348] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } }
I20260806 15:56:19.433388 19193 raft_consensus.cc:374] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:56:19.433447 19193 raft_consensus.cc:729] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce2255c97cc240d79310c0e7e4a3d736, State: Initialized, Role: FOLLOWER
I20260806 15:56:19.434279 19193 consensus_queue.cc:260] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } }
I20260806 15:56:19.435971 19038 heartbeater.cc:503] Master 127.10.189.254:42685 was elected leader, sending a full tablet report...
I20260806 15:56:19.436051 19193 ts_tablet_manager.cc:1428] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
W20260806 15:56:19.446017 19039 tablet.cc:2369] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 15:56:19.459364 18905 tablet.cc:2369] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 15:56:19.464874 19175 tablet.cc:2369] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:56:19.661983 19199 raft_consensus.cc:482] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:56:19.662231 19199 raft_consensus.cc:504] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } }
I20260806 15:56:19.663439 19199 leader_election.cc:288] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 940a8a11d092473a97863482fd7b5c88 (127.10.189.193:35469), b841735cb31d47e8900ce596c78170a9 (127.10.189.195:39283)
I20260806 15:56:19.668074 18855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b8ffc23a3342c5b86aa46d4706813d" candidate_uuid: "ce2255c97cc240d79310c0e7e4a3d736" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "940a8a11d092473a97863482fd7b5c88" is_pre_election: true
I20260806 15:56:19.668164 19125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b8ffc23a3342c5b86aa46d4706813d" candidate_uuid: "ce2255c97cc240d79310c0e7e4a3d736" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b841735cb31d47e8900ce596c78170a9" is_pre_election: true
I20260806 15:56:19.668426 19125 raft_consensus.cc:2454] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce2255c97cc240d79310c0e7e4a3d736 in term 0.
I20260806 15:56:19.668417 18855 raft_consensus.cc:2454] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce2255c97cc240d79310c0e7e4a3d736 in term 0.
I20260806 15:56:19.668931 18924 leader_election.cc:302] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 940a8a11d092473a97863482fd7b5c88, b841735cb31d47e8900ce596c78170a9, ce2255c97cc240d79310c0e7e4a3d736; no voters:
I20260806 15:56:19.669224 19199 raft_consensus.cc:2781] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:56:19.669325 19199 raft_consensus.cc:482] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:56:19.669392 19199 raft_consensus.cc:3037] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:19.670406 19199 raft_consensus.cc:504] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } }
I20260806 15:56:19.670765 19199 leader_election.cc:288] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [CANDIDATE]: Term 1 election: Requested vote from peers 940a8a11d092473a97863482fd7b5c88 (127.10.189.193:35469), b841735cb31d47e8900ce596c78170a9 (127.10.189.195:39283)
I20260806 15:56:19.671209 18855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b8ffc23a3342c5b86aa46d4706813d" candidate_uuid: "ce2255c97cc240d79310c0e7e4a3d736" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "940a8a11d092473a97863482fd7b5c88"
I20260806 15:56:19.671294 19125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b8ffc23a3342c5b86aa46d4706813d" candidate_uuid: "ce2255c97cc240d79310c0e7e4a3d736" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b841735cb31d47e8900ce596c78170a9"
I20260806 15:56:19.671362 18855 raft_consensus.cc:3037] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:19.671408 19125 raft_consensus.cc:3037] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:19.672650 18855 raft_consensus.cc:2454] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce2255c97cc240d79310c0e7e4a3d736 in term 1.
I20260806 15:56:19.672650 19125 raft_consensus.cc:2454] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce2255c97cc240d79310c0e7e4a3d736 in term 1.
I20260806 15:56:19.672976 18925 leader_election.cc:302] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b841735cb31d47e8900ce596c78170a9, ce2255c97cc240d79310c0e7e4a3d736; no voters:
I20260806 15:56:19.673169 19199 raft_consensus.cc:2781] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:19.673393 19199 raft_consensus.cc:686] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 1 LEADER]: Becoming Leader. State: Replica: ce2255c97cc240d79310c0e7e4a3d736, State: Running, Role: LEADER
I20260806 15:56:19.673736 19199 consensus_queue.cc:237] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } }
I20260806 15:56:19.676936 18702 catalog_manager.cc:5495] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce2255c97cc240d79310c0e7e4a3d736 (127.10.189.194). New cstate: current_term: 1 leader_uuid: "ce2255c97cc240d79310c0e7e4a3d736" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } } }
I20260806 15:56:19.697866 10999 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:56:19.699404 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 940a8a11d092473a97863482fd7b5c88 to finish bootstrapping
I20260806 15:56:19.705850 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver ce2255c97cc240d79310c0e7e4a3d736 to finish bootstrapping
I20260806 15:56:19.711637 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver b841735cb31d47e8900ce596c78170a9 to finish bootstrapping
I20260806 15:56:19.729692 10999 cluster_itest_util.cc:256] Not converged past 1 yet: 0.0 1.1 0.0
I20260806 15:56:19.832480 10999 cluster_itest_util.cc:256] Not converged past 1 yet: 0.0 1.1 0.0
I20260806 15:56:20.035439 10999 cluster_itest_util.cc:256] Not converged past 1 yet: 0.0 1.1 0.0
I20260806 15:56:20.144227 19199 consensus_queue.cc:1035] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:56:20.150386 19199 consensus_queue.cc:1035] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [LEADER]: Connected to new peer: Peer: permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:56:20.451382 10999 test_util.cc:268] Using random seed: -304819158
I20260806 15:56:20.757565 10999 test_util.cc:268] Using random seed: -304512976
I20260806 15:56:21.163486 10999 test_util.cc:268] Using random seed: -304107052
I20260806 15:56:21.650182 19213 raft_consensus.cc:482] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce2255c97cc240d79310c0e7e4a3d736)
I20260806 15:56:21.650336 19213 raft_consensus.cc:504] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } }
I20260806 15:56:21.651487 19213 leader_election.cc:288] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 940a8a11d092473a97863482fd7b5c88 (127.10.189.193:35469), ce2255c97cc240d79310c0e7e4a3d736 (127.10.189.194:39589)
I20260806 15:56:21.652506 19217 raft_consensus.cc:482] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce2255c97cc240d79310c0e7e4a3d736)
I20260806 15:56:21.652631 19217 raft_consensus.cc:504] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } }
I20260806 15:56:21.653669 19217 leader_election.cc:288] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b841735cb31d47e8900ce596c78170a9 (127.10.189.195:39283), ce2255c97cc240d79310c0e7e4a3d736 (127.10.189.194:39589)
I20260806 15:56:21.656523 18855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b8ffc23a3342c5b86aa46d4706813d" candidate_uuid: "b841735cb31d47e8900ce596c78170a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "940a8a11d092473a97863482fd7b5c88" is_pre_election: true
I20260806 15:56:21.656692 18855 raft_consensus.cc:2454] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b841735cb31d47e8900ce596c78170a9 in term 1.
I20260806 15:56:21.657110 19059 leader_election.cc:302] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 940a8a11d092473a97863482fd7b5c88, b841735cb31d47e8900ce596c78170a9; no voters:
I20260806 15:56:21.657388 19213 raft_consensus.cc:2781] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260806 15:56:21.657466 19213 raft_consensus.cc:482] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce2255c97cc240d79310c0e7e4a3d736)
I20260806 15:56:21.657526 19213 raft_consensus.cc:3037] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:21.658483 19125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b8ffc23a3342c5b86aa46d4706813d" candidate_uuid: "940a8a11d092473a97863482fd7b5c88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b841735cb31d47e8900ce596c78170a9" is_pre_election: true
I20260806 15:56:21.661091 19213 raft_consensus.cc:504] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } }
I20260806 15:56:21.661422 19125 raft_consensus.cc:2379] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 940a8a11d092473a97863482fd7b5c88 in current term 2: Already voted for candidate b841735cb31d47e8900ce596c78170a9 in this term.
I20260806 15:56:21.661523 19213 leader_election.cc:288] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [CANDIDATE]: Term 2 election: Requested vote from peers 940a8a11d092473a97863482fd7b5c88 (127.10.189.193:35469), ce2255c97cc240d79310c0e7e4a3d736 (127.10.189.194:39589)
I20260806 15:56:21.661914 18855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b8ffc23a3342c5b86aa46d4706813d" candidate_uuid: "b841735cb31d47e8900ce596c78170a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "940a8a11d092473a97863482fd7b5c88"
I20260806 15:56:21.662071 18855 raft_consensus.cc:3037] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:21.662989 18855 raft_consensus.cc:2454] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b841735cb31d47e8900ce596c78170a9 in term 2.
I20260806 15:56:21.663276 19059 leader_election.cc:302] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 940a8a11d092473a97863482fd7b5c88, b841735cb31d47e8900ce596c78170a9; no voters:
I20260806 15:56:21.663499 19213 raft_consensus.cc:2781] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 15:56:21.663745 19213 raft_consensus.cc:686] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 2 LEADER]: Becoming Leader. State: Replica: b841735cb31d47e8900ce596c78170a9, State: Running, Role: LEADER
I20260806 15:56:21.664079 19213 consensus_queue.cc:237] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } }
I20260806 15:56:21.666425 18702 catalog_manager.cc:5495] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 reported cstate change: term changed from 1 to 2, leader changed from ce2255c97cc240d79310c0e7e4a3d736 (127.10.189.194) to b841735cb31d47e8900ce596c78170a9 (127.10.189.195). New cstate: current_term: 2 leader_uuid: "b841735cb31d47e8900ce596c78170a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } } }
I20260806 15:56:21.668764 10999 test_util.cc:268] Using random seed: -303601773
I20260806 15:56:21.669812 10999 test_util.cc:268] Using random seed: -303600722
I20260806 15:56:21.691160 10999 test_workload.cc:401] TestWorkload: Skipping table creation because table TestTable already exists
I20260806 15:56:21.691511 10999 raft_consensus-itest-base.cc:268] Waiting until we've written at least 4MB...
I20260806 15:56:21.708107 18855 raft_consensus.cc:1261] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88 [term 2 FOLLOWER]: Refusing update from remote peer b841735cb31d47e8900ce596c78170a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260806 15:56:21.708709 19221 consensus_queue.cc:1035] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260806 15:56:21.717839 19240 mvcc.cc:205] Tried to move back new op lower bound from 7315586177873141760 to 7315586177698721792. Current Snapshot: MvccSnapshot[applied={T|T < 7315586177867317248}]
I20260806 15:56:21.767684 18905 maintenance_manager.cc:419] P 940a8a11d092473a97863482fd7b5c88: Scheduling FlushMRSOp(92b8ffc23a3342c5b86aa46d4706813d): 3155764 bytes log retention, and flush 4038921 bytes memory
I20260806 15:56:21.772070 19175 maintenance_manager.cc:419] P b841735cb31d47e8900ce596c78170a9: Scheduling FlushMRSOp(92b8ffc23a3342c5b86aa46d4706813d): 3681856 bytes log retention, and flush 5079305 bytes memory
I20260806 15:56:21.807540 10999 raft_consensus-itest-base.cc:274] Waiting for log GC on b841735cb31d47e8900ce596c78170a9
I20260806 15:56:21.836261 18792 maintenance_manager.cc:643] P 940a8a11d092473a97863482fd7b5c88: FlushMRSOp(92b8ffc23a3342c5b86aa46d4706813d) complete. Timing: real 0.068s user 0.049s sys 0.004s Metrics: {"bytes_written":135937,"cfile_init":1,"compiler_manager_pool.queue_time_us":215,"drs_written":1,"lbm_read_time_us":76,"lbm_reads_lt_1ms":4,"lbm_write_time_us":702,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":26,"thread_start_us":241,"threads_started":2}
I20260806 15:56:21.837613 18905 maintenance_manager.cc:419] P 940a8a11d092473a97863482fd7b5c88: Scheduling LogGCOp(92b8ffc23a3342c5b86aa46d4706813d): free 2235448 bytes of WAL
I20260806 15:56:21.837953 18792 log_reader.cc:386] T 92b8ffc23a3342c5b86aa46d4706813d: removed 3 log segments from log reader
I20260806 15:56:21.838111 18792 log.cc:1076] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88: Deleting log segment in path: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/wals/92b8ffc23a3342c5b86aa46d4706813d/wal-000000001 (ops 1-8)
I20260806 15:56:21.838263 18792 log.cc:1076] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88: Deleting log segment in path: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/wals/92b8ffc23a3342c5b86aa46d4706813d/wal-000000002 (ops 9-14)
I20260806 15:56:21.838368 18792 log.cc:1076] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88: Deleting log segment in path: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/wals/92b8ffc23a3342c5b86aa46d4706813d/wal-000000003 (ops 15-19)
I20260806 15:56:21.837855 19062 maintenance_manager.cc:643] P b841735cb31d47e8900ce596c78170a9: FlushMRSOp(92b8ffc23a3342c5b86aa46d4706813d) complete. Timing: real 0.065s user 0.045s sys 0.007s Metrics: {"bytes_written":135937,"cfile_init":1,"compiler_manager_pool.queue_time_us":218,"dirs.queue_time_us":4022,"drs_written":1,"lbm_read_time_us":70,"lbm_reads_lt_1ms":4,"lbm_write_time_us":684,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":28,"thread_start_us":247,"threads_started":2}
I20260806 15:56:21.839295 18792 maintenance_manager.cc:643] P 940a8a11d092473a97863482fd7b5c88: LogGCOp(92b8ffc23a3342c5b86aa46d4706813d) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260806 15:56:21.839545 19175 maintenance_manager.cc:419] P b841735cb31d47e8900ce596c78170a9: Scheduling LogGCOp(92b8ffc23a3342c5b86aa46d4706813d): free 2761438 bytes of WAL
I20260806 15:56:21.839649 18905 maintenance_manager.cc:419] P 940a8a11d092473a97863482fd7b5c88: Scheduling UndoDeltaBlockGCOp(92b8ffc23a3342c5b86aa46d4706813d): 423 bytes on disk
I20260806 15:56:21.839982 19062 log_reader.cc:386] T 92b8ffc23a3342c5b86aa46d4706813d: removed 3 log segments from log reader
I20260806 15:56:21.840101 19062 log.cc:1076] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9: Deleting log segment in path: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/wals/92b8ffc23a3342c5b86aa46d4706813d/wal-000000001 (ops 1-9)
I20260806 15:56:21.840251 19062 log.cc:1076] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9: Deleting log segment in path: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/wals/92b8ffc23a3342c5b86aa46d4706813d/wal-000000002 (ops 10-16)
I20260806 15:56:21.840212 18792 maintenance_manager.cc:643] P 940a8a11d092473a97863482fd7b5c88: UndoDeltaBlockGCOp(92b8ffc23a3342c5b86aa46d4706813d) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":63,"lbm_reads_lt_1ms":4}
I20260806 15:56:21.840348 19062 log.cc:1076] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9: Deleting log segment in path: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/wals/92b8ffc23a3342c5b86aa46d4706813d/wal-000000003 (ops 17-23)
I20260806 15:56:21.841480 19062 maintenance_manager.cc:643] P b841735cb31d47e8900ce596c78170a9: LogGCOp(92b8ffc23a3342c5b86aa46d4706813d) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {}
I20260806 15:56:21.841864 19175 maintenance_manager.cc:419] P b841735cb31d47e8900ce596c78170a9: Scheduling UndoDeltaBlockGCOp(92b8ffc23a3342c5b86aa46d4706813d): 442 bytes on disk
I20260806 15:56:21.842504 19062 maintenance_manager.cc:643] P b841735cb31d47e8900ce596c78170a9: UndoDeltaBlockGCOp(92b8ffc23a3342c5b86aa46d4706813d) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":76,"lbm_reads_lt_1ms":4}
I20260806 15:56:21.848750 10999 raft_consensus-itest-base.cc:279] Log GC complete on b841735cb31d47e8900ce596c78170a9
W20260806 15:56:23.375144 18788 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.10.189.194:39589 for RPC RequestConsensusVote timed out after 1.720s (ON_OUTBOUND_QUEUE)
W20260806 15:56:23.525126 19058 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.10.189.194:39589 for RPC RequestConsensusVote timed out after 1.862s (ON_OUTBOUND_QUEUE)
I20260806 15:56:23.850458 10999 raft_consensus-itest-base.cc:295] Servers converged with original term 2
I20260806 15:56:23.850569 10999 raft_consensus-itest-base.cc:300] Resuming ce2255c97cc240d79310c0e7e4a3d736
I20260806 15:56:23.853835 19125 raft_consensus.cc:1226] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 2 LEADER]: Rejecting Update request from peer ce2255c97cc240d79310c0e7e4a3d736 for earlier term 1. Current term is 2. Ops: []
I20260806 15:56:23.855355 18854 raft_consensus.cc:1226] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88 [term 2 FOLLOWER]: Rejecting Update request from peer ce2255c97cc240d79310c0e7e4a3d736 for earlier term 1. Current term is 2. Ops: []
I20260806 15:56:23.855795 19199 consensus_queue.cc:1046] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 39, Time since last communication: 0.000s
I20260806 15:56:23.856076 19199 raft_consensus.cc:3032] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 1 LEADER]: Stepping down as leader of term 1
I20260806 15:56:23.856137 19199 raft_consensus.cc:729] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce2255c97cc240d79310c0e7e4a3d736, State: Running, Role: LEADER
I20260806 15:56:23.856287 19199 consensus_queue.cc:260] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } }
I20260806 15:56:23.856631 19199 raft_consensus.cc:3037] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:23.859020 18988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b8ffc23a3342c5b86aa46d4706813d" candidate_uuid: "940a8a11d092473a97863482fd7b5c88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce2255c97cc240d79310c0e7e4a3d736" is_pre_election: true
I20260806 15:56:23.859274 18988 raft_consensus.cc:2454] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 940a8a11d092473a97863482fd7b5c88 in term 2.
I20260806 15:56:23.859699 18987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b8ffc23a3342c5b86aa46d4706813d" candidate_uuid: "b841735cb31d47e8900ce596c78170a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce2255c97cc240d79310c0e7e4a3d736" is_pre_election: true
I20260806 15:56:23.859680 18788 leader_election.cc:302] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 940a8a11d092473a97863482fd7b5c88, ce2255c97cc240d79310c0e7e4a3d736; no voters: b841735cb31d47e8900ce596c78170a9
I20260806 15:56:23.859977 18986 raft_consensus.cc:1261] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 2 FOLLOWER]: Refusing update from remote peer b841735cb31d47e8900ce596c78170a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260806 15:56:23.860105 19264 raft_consensus.cc:2741] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260806 15:56:23.860340 18988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b8ffc23a3342c5b86aa46d4706813d" candidate_uuid: "b841735cb31d47e8900ce596c78170a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce2255c97cc240d79310c0e7e4a3d736"
I20260806 15:56:23.860668 19260 consensus_queue.cc:1035] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260806 15:56:23.861032 19260 consensus_queue.cc:740] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [LEADER]: The logs necessary to catch up peer ce2255c97cc240d79310c0e7e4a3d736 have been garbage collected. The follower will never be able to catch up (Not found: failed to read ops 2..32: Segment 1 which contained index 2 has been GCed)
I20260806 15:56:23.861326 18988 raft_consensus.cc:2454] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b841735cb31d47e8900ce596c78170a9 in term 2.
I20260806 15:56:23.861413 19265 raft_consensus.cc:998] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9: Attempting to remove follower ce2255c97cc240d79310c0e7e4a3d736 from the Raft config. Reason: The logs necessary to catch up peer ce2255c97cc240d79310c0e7e4a3d736 have been garbage collected. The replica will never be able to catch up
I20260806 15:56:23.862071 19265 consensus_queue.cc:237] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 39, Committed index: 39, Last appended: 2.39, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } }
I20260806 15:56:23.863329 18854 raft_consensus.cc:1261] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88 [term 2 FOLLOWER]: Refusing update from remote peer b841735cb31d47e8900ce596c78170a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 39. Preceding OpId from leader: term: 2 index: 40. (index mismatch)
I20260806 15:56:23.863796 19260 consensus_queue.cc:1035] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 40, Last known committed idx: 39, Time since last communication: 0.000s
I20260806 15:56:23.865688 19265 raft_consensus.cc:2932] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 2 LEADER]: Committing config change with OpId 2.40: config changed from index -1 to 40, VOTER ce2255c97cc240d79310c0e7e4a3d736 (127.10.189.194) evicted. New config: { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } }
I20260806 15:56:23.866219 18854 raft_consensus.cc:2932] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88 [term 2 FOLLOWER]: Committing config change with OpId 2.40: config changed from index -1 to 40, VOTER ce2255c97cc240d79310c0e7e4a3d736 (127.10.189.194) evicted. New config: { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } }
I20260806 15:56:23.868487 18707 catalog_manager.cc:5495] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 reported cstate change: config changed from index -1 to 40, VOTER ce2255c97cc240d79310c0e7e4a3d736 (127.10.189.194) evicted. New cstate: current_term: 2 leader_uuid: "b841735cb31d47e8900ce596c78170a9" committed_config { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } }
I20260806 15:56:23.872054 18971 tablet_service.cc:1514] Processing DeleteTablet for tablet 92b8ffc23a3342c5b86aa46d4706813d with delete_type TABLET_DATA_TOMBSTONED (TS ce2255c97cc240d79310c0e7e4a3d736 not found in new config with opid_index 40) from {username='slave'} at 127.0.0.1:52562
I20260806 15:56:23.872587 19273 tablet_replica.cc:330] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: stopping tablet replica
I20260806 15:56:23.872964 19273 raft_consensus.cc:2229] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260806 15:56:23.873221 19273 raft_consensus.cc:2258] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260806 15:56:23.874296 19273 ts_tablet_manager.cc:1905] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260806 15:56:23.876909 19273 ts_tablet_manager.cc:1918] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260806 15:56:23.877043 19273 log.cc:1196] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: Deleting WAL directory at /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/wals/92b8ffc23a3342c5b86aa46d4706813d
I20260806 15:56:23.877751 18692 catalog_manager.cc:4841] TS ce2255c97cc240d79310c0e7e4a3d736 (127.10.189.194:39589): tablet 92b8ffc23a3342c5b86aa46d4706813d (table TestTable [id=4a1cc96af9d5417f8ffa74431d47e7f3]) successfully deleted
I20260806 15:56:23.882496 19032 generic_service.cc:175] {username='slave'} at 127.0.0.1:52572 changed flags via RPC: tablet_copy_fault_crash_on_fetch_all from '0' to '1.0'
I20260806 15:56:23.883880 19125 consensus_queue.cc:237] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 40, Committed index: 40, Last appended: 2.40, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 41 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } attrs { } }
I20260806 15:56:23.885334 18854 raft_consensus.cc:1261] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88 [term 2 FOLLOWER]: Refusing update from remote peer b841735cb31d47e8900ce596c78170a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 40. Preceding OpId from leader: term: 2 index: 41. (index mismatch)
W20260806 15:56:23.885722 19058 consensus_peers.cc:487] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 -> Peer ce2255c97cc240d79310c0e7e4a3d736 (127.10.189.194:39589): Couldn't send request to peer ce2255c97cc240d79310c0e7e4a3d736. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260806 15:56:23.886157 19260 consensus_queue.cc:1035] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 41, Last known committed idx: 40, Time since last communication: 0.000s
I20260806 15:56:23.887815 19265 raft_consensus.cc:2932] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 2 LEADER]: Committing config change with OpId 2.41: config changed from index 40 to 41, VOTER ce2255c97cc240d79310c0e7e4a3d736 (127.10.189.194) added. New config: { opid_index: 41 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } attrs { } } }
I20260806 15:56:23.888356 18854 raft_consensus.cc:2932] T 92b8ffc23a3342c5b86aa46d4706813d P 940a8a11d092473a97863482fd7b5c88 [term 2 FOLLOWER]: Committing config change with OpId 2.41: config changed from index 40 to 41, VOTER ce2255c97cc240d79310c0e7e4a3d736 (127.10.189.194) added. New config: { opid_index: 41 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } attrs { } } }
I20260806 15:56:23.890741 18706 catalog_manager.cc:5495] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 reported cstate change: config changed from index 40 to 41, VOTER ce2255c97cc240d79310c0e7e4a3d736 (127.10.189.194) added. New cstate: current_term: 2 leader_uuid: "b841735cb31d47e8900ce596c78170a9" committed_config { opid_index: 41 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } attrs { } } }
I20260806 15:56:24.337627 19274 ts_tablet_manager.cc:927] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: Initiating tablet copy from peer b841735cb31d47e8900ce596c78170a9 (127.10.189.195:39283)
I20260806 15:56:24.338369 19274 tablet_copy_client.cc:316] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: tablet copy: Beginning tablet copy session from remote peer at address 127.10.189.195:39283
I20260806 15:56:24.339255 19147 tablet_copy_service.cc:140] P b841735cb31d47e8900ce596c78170a9: Received BeginTabletCopySession request for tablet 92b8ffc23a3342c5b86aa46d4706813d from peer ce2255c97cc240d79310c0e7e4a3d736 ({username='slave'} at 127.10.189.194:33105)
I20260806 15:56:24.339473 19147 tablet_copy_service.cc:161] P b841735cb31d47e8900ce596c78170a9: Beginning new tablet copy session on tablet 92b8ffc23a3342c5b86aa46d4706813d from peer ce2255c97cc240d79310c0e7e4a3d736 at {username='slave'} at 127.10.189.194:33105: session id = ce2255c97cc240d79310c0e7e4a3d736-92b8ffc23a3342c5b86aa46d4706813d
I20260806 15:56:24.341221 19147 tablet_copy_source_session.cc:205] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9: Tablet Copy: opened 5 blocks and 3 log segments
I20260806 15:56:24.343146 19274 ts_tablet_manager.cc:1905] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260806 15:56:24.345364 19274 ts_tablet_manager.cc:1918] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.1
I20260806 15:56:24.345578 19274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92b8ffc23a3342c5b86aa46d4706813d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260806 15:56:24.346845 19274 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260806 15:56:24.346899 19274 fault_injection.cc:44] THIS SERVER MAY CRASH!
E20260806 15:56:24.346930 19274 fault_injection.cc:59] injecting fault for kudu (pid 18907): FLAGS_tablet_copy_fault_crash_on_fetch_all (process will exit)
I20260806 15:56:24.441973 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 18771
I20260806 15:56:24.450776 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 19042
I20260806 15:56:24.458230 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 18676
I20260806 15:56:24.466317 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:42685
--webserver_interface=127.10.189.254
--webserver_port=37263
--builtin_ntp_servers=127.10.189.212:40229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.189.254:42685
--master_add_server_when_underreplicated=false
--raft_prepare_replacement_before_eviction=false with env {}
W20260806 15:56:24.577986 19276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:24.578269 19276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:24.578302 19276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:24.582325 19276 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260806 15:56:24.582383 19276 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:56:24.582401 19276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:24.582417 19276 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:56:24.582484 19276 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:56:24.587291 19276 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:40229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--master_add_server_when_underreplicated=false
--ipki_ca_key_size=768
--master_addresses=127.10.189.254:42685
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:42685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.10.189.254
--webserver_port=37263
--never_fsync=true
--heap_profile_path=/tmp/kudu.19276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:24.588342 19276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:24.589730 19276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:24.598578 19284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:24.598531 19281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:24.598721 19276 server_base.cc:1034] running on GCE node
W20260806 15:56:24.598538 19282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:24.599494 19276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:24.600618 19276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:24.601773 19276 hybrid_clock.cc:648] HybridClock initialized: now 1786031784601745 us; error 41 us; skew 500 ppm
I20260806 15:56:24.603740 19276 webserver.cc:460] Webserver started at http://127.10.189.254:37263/ using document root <none> and password file <none>
I20260806 15:56:24.604292 19276 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:24.604368 19276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:24.608237 19276 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260806 15:56:24.610520 19290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:24.611786 19276 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 15:56:24.611888 19276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
uuid: "3225fe33f44e49f8ae6de7fd9d93407d"
format_stamp: "Formatted at 2026-08-06 15:56:18 on dist-test-slave-mn4r"
I20260806 15:56:24.612488 19276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:24.632303 19276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:24.633052 19276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:24.633263 19276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:24.640501 19276 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.254:42685
I20260806 15:56:24.640527 19344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.254:42685 every 8 connection(s)
I20260806 15:56:24.641553 19276 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260806 15:56:24.643136 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 19276
I20260806 15:56:24.643608 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.195:39283
--local_ip_for_outbound_sockets=127.10.189.195
--tserver_master_addrs=127.10.189.254:42685
--webserver_port=41027
--webserver_interface=127.10.189.195
--builtin_ntp_servers=127.10.189.212:40229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20260806 15:56:24.646344 19345 sys_catalog.cc:263] Verifying existing consensus state
I20260806 15:56:24.647943 19345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d: Bootstrap starting.
I20260806 15:56:24.663167 19345 log.cc:824] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:24.672371 19345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=5 ignored=0} mutations{seen=5 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 15:56:24.672796 19345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d: Bootstrap complete.
I20260806 15:56:24.676993 19345 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3225fe33f44e49f8ae6de7fd9d93407d" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42685 } }
I20260806 15:56:24.677433 19345 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3225fe33f44e49f8ae6de7fd9d93407d, State: Initialized, Role: FOLLOWER
I20260806 15:56:24.677997 19345 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3225fe33f44e49f8ae6de7fd9d93407d" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42685 } }
I20260806 15:56:24.678194 19345 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:56:24.678270 19345 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:56:24.678396 19345 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:24.680326 19345 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3225fe33f44e49f8ae6de7fd9d93407d" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42685 } }
I20260806 15:56:24.680691 19345 leader_election.cc:302] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3225fe33f44e49f8ae6de7fd9d93407d; no voters:
I20260806 15:56:24.681046 19345 leader_election.cc:288] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 15:56:24.681144 19349 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [term 2 FOLLOWER]: Leader election won for term 2
I20260806 15:56:24.681365 19349 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [term 2 LEADER]: Becoming Leader. State: Replica: 3225fe33f44e49f8ae6de7fd9d93407d, State: Running, Role: LEADER
I20260806 15:56:24.681741 19349 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3225fe33f44e49f8ae6de7fd9d93407d" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42685 } }
I20260806 15:56:24.682433 19345 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:56:24.683336 19350 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3225fe33f44e49f8ae6de7fd9d93407d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3225fe33f44e49f8ae6de7fd9d93407d" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42685 } } }
I20260806 15:56:24.683491 19350 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [sys.catalog]: This master's current role is: LEADER
I20260806 15:56:24.684243 19351 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3225fe33f44e49f8ae6de7fd9d93407d. Latest consensus state: current_term: 2 leader_uuid: "3225fe33f44e49f8ae6de7fd9d93407d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3225fe33f44e49f8ae6de7fd9d93407d" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42685 } } }
I20260806 15:56:24.684460 19351 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d [sys.catalog]: This master's current role is: LEADER
I20260806 15:56:24.688676 19365 catalog_manager.cc:1259] Loaded cluster ID: c293dd9ed801424aa0eb63dcfe955757
I20260806 15:56:24.688760 19365 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d: loading cluster ID for follower catalog manager: success
I20260806 15:56:24.691519 19365 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d: acquiring CA information for follower catalog manager: success
I20260806 15:56:24.692930 19365 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 15:56:24.693279 19356 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:56:24.694931 19356 catalog_manager.cc:669] Loaded metadata for table TestTable [id=4a1cc96af9d5417f8ffa74431d47e7f3]
I20260806 15:56:24.696202 19356 tablet_loader.cc:96] loaded metadata for tablet 92b8ffc23a3342c5b86aa46d4706813d (table TestTable [id=4a1cc96af9d5417f8ffa74431d47e7f3])
I20260806 15:56:24.696362 19356 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:56:24.696810 19356 catalog_manager.cc:1259] Loaded cluster ID: c293dd9ed801424aa0eb63dcfe955757
I20260806 15:56:24.696866 19356 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:56:24.697500 19356 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:56:24.697978 19356 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3225fe33f44e49f8ae6de7fd9d93407d: Loaded TSK: 0
I20260806 15:56:24.698715 19356 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 15:56:24.763078 19347 flags.cc:425] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20260806 15:56:24.763358 19347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:24.763378 19347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:24.763410 19347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:24.767395 19347 flags.cc:425] Enabled experimental flag: --log_compression_codec=no_compression
W20260806 15:56:24.767484 19347 flags.cc:425] Enabled experimental flag: --log_max_segments_to_retain=3
W20260806 15:56:24.767527 19347 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260806 15:56:24.767577 19347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:24.767673 19347 flags.cc:425] Enabled experimental flag: --log_target_replay_size_mb=1
W20260806 15:56:24.767724 19347 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.195
I20260806 15:56:24.772361 19347 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:40229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.195:39283
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.189.195
--webserver_port=41027
--tserver_master_addrs=127.10.189.254:42685
--never_fsync=true
--heap_profile_path=/tmp/kudu.19347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.195
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:24.773387 19347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:24.774742 19347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:24.784368 19372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:24.784363 19371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:24.784682 19347 server_base.cc:1034] running on GCE node
W20260806 15:56:24.784492 19374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:24.785197 19347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:24.785859 19347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:24.787048 19347 hybrid_clock.cc:648] HybridClock initialized: now 1786031784787028 us; error 61 us; skew 500 ppm
I20260806 15:56:24.788872 19347 webserver.cc:460] Webserver started at http://127.10.189.195:41027/ using document root <none> and password file <none>
I20260806 15:56:24.789453 19347 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:24.789565 19347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:24.793598 19347 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 15:56:24.799707 19384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:24.800930 19347 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.000s
I20260806 15:56:24.801033 19347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "b841735cb31d47e8900ce596c78170a9"
format_stamp: "Formatted at 2026-08-06 15:56:19 on dist-test-slave-mn4r"
I20260806 15:56:24.801604 19347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 5
Total live bytes: 136379
Total live bytes (after alignment): 155648
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:24.813138 19347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:24.813814 19347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:24.814018 19347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:24.814625 19347 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:24.815958 19391 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 15:56:24.822049 19347 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 15:56:24.822188 19347 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260806 15:56:24.822281 19347 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 15:56:24.823834 19347 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 15:56:24.823907 19347 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260806 15:56:24.824177 19391 tablet_bootstrap.cc:492] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9: Bootstrap starting.
I20260806 15:56:24.834865 19347 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.195:39283
I20260806 15:56:24.834939 19502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.195:39283 every 8 connection(s)
I20260806 15:56:24.835804 19347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260806 15:56:24.837817 19391 log.cc:824] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:24.840703 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 19347
I20260806 15:56:24.841290 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.194:39589
--local_ip_for_outbound_sockets=127.10.189.194
--tserver_master_addrs=127.10.189.254:42685
--webserver_port=44761
--webserver_interface=127.10.189.194
--builtin_ntp_servers=127.10.189.212:40229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20260806 15:56:24.847470 19391 tablet_bootstrap.cc:492] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9: Bootstrap replayed 1/3 log segments. Stats: ops{read=7 overwritten=0 applied=5 ignored=5} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 2 replicates
I20260806 15:56:24.849466 19503 heartbeater.cc:347] Connected to a master server at 127.10.189.254:42685
I20260806 15:56:24.849706 19503 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:24.850186 19503 heartbeater.cc:511] Master 127.10.189.254:42685 requested a full tablet report, sending...
I20260806 15:56:24.852435 19305 ts_manager.cc:194] Registered new tserver with Master: b841735cb31d47e8900ce596c78170a9 (127.10.189.195:39283)
I20260806 15:56:24.854571 19305 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.195:48557
I20260806 15:56:24.858600 19391 tablet_bootstrap.cc:492] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9: Bootstrap replayed 2/3 log segments. Stats: ops{read=14 overwritten=0 applied=12 ignored=7} inserts{seen=5 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 2 replicates
I20260806 15:56:24.863972 19391 tablet_bootstrap.cc:492] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9: Bootstrap replayed 3/3 log segments. Stats: ops{read=18 overwritten=0 applied=18 ignored=7} inserts{seen=9 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 0 replicates
I20260806 15:56:24.864509 19391 tablet_bootstrap.cc:492] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9: Bootstrap complete.
I20260806 15:56:24.865612 19391 ts_tablet_manager.cc:1397] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9: Time spent bootstrapping tablet: real 0.042s user 0.021s sys 0.016s
I20260806 15:56:24.868818 19391 raft_consensus.cc:348] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 41 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } attrs { } }
I20260806 15:56:24.869462 19391 raft_consensus.cc:729] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b841735cb31d47e8900ce596c78170a9, State: Initialized, Role: FOLLOWER
I20260806 15:56:24.869990 19391 consensus_queue.cc:260] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 41, Last appended: 2.41, Last appended by leader: 41, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 41 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } attrs { } }
I20260806 15:56:24.870708 19503 heartbeater.cc:503] Master 127.10.189.254:42685 was elected leader, sending a full tablet report...
I20260806 15:56:24.871119 19391 ts_tablet_manager.cc:1428] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20260806 15:56:24.937644 19504 maintenance_manager.cc:419] P b841735cb31d47e8900ce596c78170a9: Scheduling UndoDeltaBlockGCOp(92b8ffc23a3342c5b86aa46d4706813d): 442 bytes on disk
I20260806 15:56:24.938757 19389 maintenance_manager.cc:643] P b841735cb31d47e8900ce596c78170a9: UndoDeltaBlockGCOp(92b8ffc23a3342c5b86aa46d4706813d) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":61,"lbm_reads_lt_1ms":4}
W20260806 15:56:24.963713 19509 flags.cc:425] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20260806 15:56:24.964066 19509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:24.964138 19509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:24.964215 19509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:24.968813 19509 flags.cc:425] Enabled experimental flag: --log_compression_codec=no_compression
W20260806 15:56:24.968890 19509 flags.cc:425] Enabled experimental flag: --log_max_segments_to_retain=3
W20260806 15:56:24.968935 19509 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260806 15:56:24.968990 19509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:24.969082 19509 flags.cc:425] Enabled experimental flag: --log_target_replay_size_mb=1
W20260806 15:56:24.969130 19509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.194
I20260806 15:56:24.973961 19509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:40229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.194:39589
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.10.189.194
--webserver_port=44761
--tserver_master_addrs=127.10.189.254:42685
--never_fsync=true
--heap_profile_path=/tmp/kudu.19509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.194
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:24.975230 19509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:24.976658 19509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:24.986914 19518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:24.986910 19515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:24.986997 19516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:24.987169 19509 server_base.cc:1034] running on GCE node
I20260806 15:56:24.987558 19509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:24.988204 19509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:24.989383 19509 hybrid_clock.cc:648] HybridClock initialized: now 1786031784989326 us; error 51 us; skew 500 ppm
I20260806 15:56:24.991271 19509 webserver.cc:460] Webserver started at http://127.10.189.194:44761/ using document root <none> and password file <none>
I20260806 15:56:24.991851 19509 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:24.991958 19509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:24.995790 19509 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260806 15:56:24.997787 19524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:24.999050 19509 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 15:56:24.999184 19509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "ce2255c97cc240d79310c0e7e4a3d736"
format_stamp: "Formatted at 2026-08-06 15:56:19 on dist-test-slave-mn4r"
I20260806 15:56:24.999751 19509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:25.009872 19509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:25.010576 19509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:25.010766 19509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:25.011336 19509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:25.012480 19531 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
W20260806 15:56:25.016165 19531 ts_tablet_manager.cc:1852] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_COPYING
I20260806 15:56:25.017470 19531 ts_tablet_manager.cc:1905] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260806 15:56:25.021293 19531 ts_tablet_manager.cc:1918] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260806 15:56:25.022245 19509 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260806 15:56:25.022326 19509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.010s user 0.000s sys 0.000s
I20260806 15:56:25.022408 19509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:25.022459 19509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:25.031567 19509 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.194:39589
I20260806 15:56:25.031608 19641 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.194:39589 every 8 connection(s)
I20260806 15:56:25.032441 19509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260806 15:56:25.040381 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 19509
I20260806 15:56:25.040580 10999 test_util.cc:268] Using random seed: -300229949
I20260806 15:56:25.042533 19642 heartbeater.cc:347] Connected to a master server at 127.10.189.254:42685
I20260806 15:56:25.042796 19642 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:25.043325 19642 heartbeater.cc:511] Master 127.10.189.254:42685 requested a full tablet report, sending...
I20260806 15:56:25.044782 19305 ts_manager.cc:194] Registered new tserver with Master: ce2255c97cc240d79310c0e7e4a3d736 (127.10.189.194:39589)
I20260806 15:56:25.045552 19305 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.194:37579
I20260806 15:56:25.051827 10999 test_workload.cc:401] TestWorkload: Skipping table creation because table TestTable already exists
W20260806 15:56:25.078918 19417 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.078920 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.078920 19416 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.078934 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.083549 19646 meta_cache.cc:302] tablet 92b8ffc23a3342c5b86aa46d4706813d: replica 940a8a11d092473a97863482fd7b5c88 (127.10.189.193:35469) has failed: Network error: Client connection negotiation failed: client connection to 127.10.189.193:35469: connect: Connection refused (error 111)
W20260806 15:56:25.096244 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.103994 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.104139 19416 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.115814 19416 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.122911 19416 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.132234 19416 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.139868 19416 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.146549 19416 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.168831 19416 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.169312 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.169508 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.184432 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.201938 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.215816 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.229760 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.246415 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.261071 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.280239 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.280462 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.301084 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.301084 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.323812 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.328334 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.351323 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.375663 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.375790 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.403602 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.430298 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.456284 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.476269 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.505389 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.534027 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.566501 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.575024 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.604028 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.635043 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.667980 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.704684 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.706205 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.743958 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.743975 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.780649 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.821566 19415 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.821566 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.861485 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.897840 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.938057 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.944397 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:25.988420 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:26.033258 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
I20260806 15:56:26.047866 19642 heartbeater.cc:503] Master 127.10.189.254:42685 was elected leader, sending a full tablet report...
W20260806 15:56:26.076442 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:26.106926 19646 meta_cache.cc:302] tablet 92b8ffc23a3342c5b86aa46d4706813d: replica 940a8a11d092473a97863482fd7b5c88 (127.10.189.193:35469) has failed: Network error: Client connection negotiation failed: client connection to 127.10.189.193:35469: connect: Connection refused (error 111)
W20260806 15:56:26.114567 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:26.160775 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:26.202767 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:26.249970 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
W20260806 15:56:26.266255 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
I20260806 15:56:26.292160 19659 raft_consensus.cc:482] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:56:26.292413 19659 raft_consensus.cc:504] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 41 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } attrs { } }
I20260806 15:56:26.293576 19659 leader_election.cc:288] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 940a8a11d092473a97863482fd7b5c88 (127.10.189.193:35469), ce2255c97cc240d79310c0e7e4a3d736 (127.10.189.194:39589)
W20260806 15:56:26.294489 19386 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.189.193:35469: connect: Connection refused (error 111)
W20260806 15:56:26.295470 19386 leader_election.cc:334] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 940a8a11d092473a97863482fd7b5c88 (127.10.189.193:35469): Network error: Client connection negotiation failed: client connection to 127.10.189.193:35469: connect: Connection refused (error 111)
I20260806 15:56:26.298281 19595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b8ffc23a3342c5b86aa46d4706813d" candidate_uuid: "b841735cb31d47e8900ce596c78170a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 41 } } ignore_live_leader: false dest_uuid: "ce2255c97cc240d79310c0e7e4a3d736" is_pre_election: true
I20260806 15:56:26.299330 19595 raft_consensus.cc:1789] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 1.1
I20260806 15:56:26.299858 19595 raft_consensus.cc:2454] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b841735cb31d47e8900ce596c78170a9 in term 2.
I20260806 15:56:26.300276 19385 leader_election.cc:302] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b841735cb31d47e8900ce596c78170a9, ce2255c97cc240d79310c0e7e4a3d736; no voters: 940a8a11d092473a97863482fd7b5c88
I20260806 15:56:26.300561 19659 raft_consensus.cc:2781] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260806 15:56:26.300642 19659 raft_consensus.cc:482] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:56:26.300689 19659 raft_consensus.cc:3037] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 2 FOLLOWER]: Advancing to term 3
W20260806 15:56:26.302945 19414 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:49654: Illegal state: replica b841735cb31d47e8900ce596c78170a9 is not leader of this config: current role FOLLOWER
I20260806 15:56:26.303372 19659 raft_consensus.cc:504] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 41 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } attrs { } }
I20260806 15:56:26.303705 19659 leader_election.cc:288] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [CANDIDATE]: Term 3 election: Requested vote from peers 940a8a11d092473a97863482fd7b5c88 (127.10.189.193:35469), ce2255c97cc240d79310c0e7e4a3d736 (127.10.189.194:39589)
I20260806 15:56:26.304157 19595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b8ffc23a3342c5b86aa46d4706813d" candidate_uuid: "b841735cb31d47e8900ce596c78170a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 41 } } ignore_live_leader: false dest_uuid: "ce2255c97cc240d79310c0e7e4a3d736"
I20260806 15:56:26.304267 19595 raft_consensus.cc:1789] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 1.1
I20260806 15:56:26.304375 19595 raft_consensus.cc:3037] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 2 FOLLOWER]: Advancing to term 3
W20260806 15:56:26.304811 19386 leader_election.cc:334] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 940a8a11d092473a97863482fd7b5c88 (127.10.189.193:35469): Network error: Client connection negotiation failed: client connection to 127.10.189.193:35469: connect: Connection refused (error 111)
I20260806 15:56:26.305691 19595 raft_consensus.cc:2454] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b841735cb31d47e8900ce596c78170a9 in term 3.
I20260806 15:56:26.305971 19385 leader_election.cc:302] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b841735cb31d47e8900ce596c78170a9, ce2255c97cc240d79310c0e7e4a3d736; no voters: 940a8a11d092473a97863482fd7b5c88
I20260806 15:56:26.306218 19659 raft_consensus.cc:2781] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 15:56:26.306396 19659 raft_consensus.cc:686] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [term 3 LEADER]: Becoming Leader. State: Replica: b841735cb31d47e8900ce596c78170a9, State: Running, Role: LEADER
I20260806 15:56:26.306736 19659 consensus_queue.cc:237] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 41, Committed index: 41, Last appended: 2.41, Last appended by leader: 41, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 41 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } attrs { } }
I20260806 15:56:26.309437 19307 catalog_manager.cc:5495] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 reported cstate change: term changed from 2 to 3. New cstate: current_term: 3 leader_uuid: "b841735cb31d47e8900ce596c78170a9" committed_config { opid_index: 41 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } attrs { } } }
W20260806 15:56:26.352566 19385 consensus_peers.cc:487] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 -> Peer ce2255c97cc240d79310c0e7e4a3d736 (127.10.189.194:39589): Couldn't send request to peer ce2255c97cc240d79310c0e7e4a3d736. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260806 15:56:26.352734 19386 consensus_peers.cc:487] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9 -> Peer 940a8a11d092473a97863482fd7b5c88 (127.10.189.193:35469): Couldn't send request to peer 940a8a11d092473a97863482fd7b5c88. Status: Network error: Client connection negotiation failed: client connection to 127.10.189.193:35469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 15:56:26.752900 19671 tablet_replica.cc:330] stopping tablet replica
I20260806 15:56:26.753116 19671 raft_consensus.cc:2229] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260806 15:56:26.753209 19671 raft_consensus.cc:2258] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260806 15:56:26.753368 19671 ts_tablet_manager.cc:927] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: Initiating tablet copy from peer b841735cb31d47e8900ce596c78170a9 (127.10.189.195:39283)
I20260806 15:56:26.753902 19671 tablet_copy_client.cc:316] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: tablet copy: Beginning tablet copy session from remote peer at address 127.10.189.195:39283
I20260806 15:56:26.758589 19477 tablet_copy_service.cc:140] P b841735cb31d47e8900ce596c78170a9: Received BeginTabletCopySession request for tablet 92b8ffc23a3342c5b86aa46d4706813d from peer ce2255c97cc240d79310c0e7e4a3d736 ({username='slave'} at 127.10.189.194:55061)
I20260806 15:56:26.758736 19477 tablet_copy_service.cc:161] P b841735cb31d47e8900ce596c78170a9: Beginning new tablet copy session on tablet 92b8ffc23a3342c5b86aa46d4706813d from peer ce2255c97cc240d79310c0e7e4a3d736 at {username='slave'} at 127.10.189.194:55061: session id = ce2255c97cc240d79310c0e7e4a3d736-92b8ffc23a3342c5b86aa46d4706813d
I20260806 15:56:26.760149 19477 tablet_copy_source_session.cc:205] T 92b8ffc23a3342c5b86aa46d4706813d P b841735cb31d47e8900ce596c78170a9: Tablet Copy: opened 5 blocks and 3 log segments
I20260806 15:56:26.762161 19671 ts_tablet_manager.cc:1905] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260806 15:56:26.765622 19671 ts_tablet_manager.cc:1918] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.1
I20260806 15:56:26.765970 19671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92b8ffc23a3342c5b86aa46d4706813d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:26.767339 19671 tablet_copy_client.cc:791] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: tablet copy: Starting download of 5 data blocks...
I20260806 15:56:26.775206 19671 tablet_copy_client.cc:655] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: tablet copy: Starting download of 3 WAL segments...
I20260806 15:56:26.784466 19671 tablet_copy_client.cc:531] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 15:56:26.787037 19671 tablet_bootstrap.cc:492] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: Bootstrap starting.
I20260806 15:56:26.795049 19671 log.cc:824] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:26.801676 19671 tablet_bootstrap.cc:492] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: Bootstrap replayed 1/3 log segments. Stats: ops{read=7 overwritten=0 applied=5 ignored=5} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260806 15:56:26.808837 19671 tablet_bootstrap.cc:492] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: Bootstrap replayed 2/3 log segments. Stats: ops{read=14 overwritten=0 applied=12 ignored=7} inserts{seen=5 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260806 15:56:26.812816 19671 tablet_bootstrap.cc:492] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: Bootstrap replayed 3/3 log segments. Stats: ops{read=23 overwritten=0 applied=18 ignored=7} inserts{seen=9 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 5 replicates
I20260806 15:56:26.813282 19671 tablet_bootstrap.cc:492] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: Bootstrap complete.
I20260806 15:56:26.814219 19671 ts_tablet_manager.cc:1397] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: Time spent bootstrapping tablet: real 0.027s user 0.018s sys 0.009s
I20260806 15:56:26.815817 19671 raft_consensus.cc:348] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 3 FOLLOWER]: Replica starting. Triggering 5 pending ops. Active config: opid_index: 41 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } attrs { } }
I20260806 15:56:26.817467 19671 raft_consensus.cc:729] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce2255c97cc240d79310c0e7e4a3d736, State: Initialized, Role: FOLLOWER
I20260806 15:56:26.817939 19671 consensus_queue.cc:260] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 41, Last appended: 3.46, Last appended by leader: 46, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 41 OBSOLETE_local: false peers { permanent_uuid: "940a8a11d092473a97863482fd7b5c88" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 35469 } } peers { permanent_uuid: "b841735cb31d47e8900ce596c78170a9" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 39283 } } peers { permanent_uuid: "ce2255c97cc240d79310c0e7e4a3d736" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 39589 } attrs { } }
I20260806 15:56:26.818874 19671 ts_tablet_manager.cc:1428] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736: Time spent starting tablet: real 0.005s user 0.001s sys 0.003s
I20260806 15:56:26.819684 19476 tablet_copy_service.cc:342] P b841735cb31d47e8900ce596c78170a9: Request end of tablet copy session ce2255c97cc240d79310c0e7e4a3d736-92b8ffc23a3342c5b86aa46d4706813d received from {username='slave'} at 127.10.189.194:55061
I20260806 15:56:26.819785 19476 tablet_copy_service.cc:433] P b841735cb31d47e8900ce596c78170a9: ending tablet copy session ce2255c97cc240d79310c0e7e4a3d736-92b8ffc23a3342c5b86aa46d4706813d on tablet 92b8ffc23a3342c5b86aa46d4706813d with peer ce2255c97cc240d79310c0e7e4a3d736
I20260806 15:56:26.837625 19643 maintenance_manager.cc:419] P ce2255c97cc240d79310c0e7e4a3d736: Scheduling UndoDeltaBlockGCOp(92b8ffc23a3342c5b86aa46d4706813d): 442 bytes on disk
I20260806 15:56:26.838718 19529 maintenance_manager.cc:643] P ce2255c97cc240d79310c0e7e4a3d736: UndoDeltaBlockGCOp(92b8ffc23a3342c5b86aa46d4706813d) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":68,"lbm_reads_lt_1ms":4}
I20260806 15:56:27.291771 19595 raft_consensus.cc:1203] T 92b8ffc23a3342c5b86aa46d4706813d P ce2255c97cc240d79310c0e7e4a3d736 [term 3 FOLLOWER]: Deduplicated request from leader. Original: 2.41->[3.42-3.46] Dedup: 3.46->[]
I20260806 15:56:27.293951 19681 mvcc.cc:205] Tried to move back new op lower bound from 7315586197087293440 to 7315586196715339776. Current Snapshot: MvccSnapshot[applied={T|T < 7315586196892131328}]
I20260806 15:56:28.084919 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 19509
I20260806 15:56:28.092937 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 19347
I20260806 15:56:28.100106 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 19276
2026-08-06T15:56:28Z chronyd exiting
[ OK ] RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy (9618 ms)
[ RUN ] RaftConsensusElectionITest.DisruptiveServerAndSlowWAL
I20260806 15:56:28.125602 10999 test_util.cc:268] Using random seed: -297144932
I20260806 15:56:28.126595 10999 ts_itest-base.cc:112] Starting cluster with:
I20260806 15:56:28.126643 10999 ts_itest-base.cc:113] --------------
I20260806 15:56:28.126654 10999 ts_itest-base.cc:114] 3 tablet servers
I20260806 15:56:28.126665 10999 ts_itest-base.cc:115] 3 replicas per TS
I20260806 15:56:28.126705 10999 ts_itest-base.cc:116] --------------
2026-08-06T15:56:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:56:28Z Disabled control of system clock
I20260806 15:56:28.136065 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:42179
--webserver_interface=127.10.189.254
--webserver_port=0
--builtin_ntp_servers=127.10.189.212:43371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.189.254:42179 with env {}
W20260806 15:56:28.248507 19707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:28.248811 19707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:28.248885 19707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:28.253029 19707 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:56:28.253116 19707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:28.253151 19707 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:56:28.253216 19707 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:56:28.257894 19707 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:43371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.189.254:42179
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:42179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.10.189.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.19707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:28.259017 19707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:28.260474 19707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:28.269446 19715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:28.269430 19713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:28.269415 19712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:28.269753 19707 server_base.cc:1034] running on GCE node
I20260806 15:56:28.270519 19707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:28.271648 19707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:28.272845 19707 hybrid_clock.cc:648] HybridClock initialized: now 1786031788272828 us; error 33 us; skew 500 ppm
I20260806 15:56:28.280115 19707 webserver.cc:460] Webserver started at http://127.10.189.254:34697/ using document root <none> and password file <none>
I20260806 15:56:28.280695 19707 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:28.280789 19707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:28.281040 19707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:28.283008 19707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "d4761f6f921c485b8339c7385a97a20a"
format_stamp: "Formatted at 2026-08-06 15:56:28 on dist-test-slave-mn4r"
I20260806 15:56:28.283555 19707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "d4761f6f921c485b8339c7385a97a20a"
format_stamp: "Formatted at 2026-08-06 15:56:28 on dist-test-slave-mn4r"
I20260806 15:56:28.287127 19707 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 15:56:28.289503 19721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:28.290886 19707 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 15:56:28.291038 19707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
uuid: "d4761f6f921c485b8339c7385a97a20a"
format_stamp: "Formatted at 2026-08-06 15:56:28 on dist-test-slave-mn4r"
I20260806 15:56:28.291180 19707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:28.302068 19707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:28.302769 19707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:28.302965 19707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:28.310233 19707 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.254:42179
I20260806 15:56:28.310253 19774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.254:42179 every 8 connection(s)
I20260806 15:56:28.311136 19707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260806 15:56:28.311734 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 19707
I20260806 15:56:28.311816 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260806 15:56:28.314734 19775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:28.320408 19775 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a: Bootstrap starting.
I20260806 15:56:28.322803 19775 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:28.323614 19775 log.cc:824] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:28.325251 19775 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a: No bootstrap required, opened a new log
I20260806 15:56:28.328727 19775 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4761f6f921c485b8339c7385a97a20a" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42179 } }
I20260806 15:56:28.328976 19775 raft_consensus.cc:374] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:56:28.329051 19775 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4761f6f921c485b8339c7385a97a20a, State: Initialized, Role: FOLLOWER
I20260806 15:56:28.329517 19775 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4761f6f921c485b8339c7385a97a20a" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42179 } }
I20260806 15:56:28.329644 19775 raft_consensus.cc:388] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:56:28.329684 19775 raft_consensus.cc:482] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:56:28.329751 19775 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:28.330550 19775 raft_consensus.cc:504] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4761f6f921c485b8339c7385a97a20a" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42179 } }
I20260806 15:56:28.330827 19775 leader_election.cc:302] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d4761f6f921c485b8339c7385a97a20a; no voters:
I20260806 15:56:28.331060 19775 leader_election.cc:288] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:56:28.331192 19780 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:28.331435 19780 raft_consensus.cc:686] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a [term 1 LEADER]: Becoming Leader. State: Replica: d4761f6f921c485b8339c7385a97a20a, State: Running, Role: LEADER
I20260806 15:56:28.331765 19780 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4761f6f921c485b8339c7385a97a20a" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42179 } }
I20260806 15:56:28.332255 19775 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:56:28.333357 19782 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4761f6f921c485b8339c7385a97a20a. Latest consensus state: current_term: 1 leader_uuid: "d4761f6f921c485b8339c7385a97a20a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4761f6f921c485b8339c7385a97a20a" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42179 } } }
I20260806 15:56:28.333484 19782 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a [sys.catalog]: This master's current role is: LEADER
I20260806 15:56:28.333892 19790 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:56:28.333868 19781 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d4761f6f921c485b8339c7385a97a20a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4761f6f921c485b8339c7385a97a20a" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 42179 } } }
I20260806 15:56:28.334475 19781 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a [sys.catalog]: This master's current role is: LEADER
I20260806 15:56:28.337415 19790 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:56:28.342671 19790 catalog_manager.cc:1347] Generated new cluster ID: 77d0e61a606e4a6da4da9662b7368862
I20260806 15:56:28.342727 19790 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:56:28.355422 19790 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:56:28.356273 19790 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:56:28.363551 19790 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d4761f6f921c485b8339c7385a97a20a: Generated new TSK 0
I20260806 15:56:28.364174 19790 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:56:28.372553 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.193:0
--local_ip_for_outbound_sockets=127.10.189.193
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42179
--builtin_ntp_servers=127.10.189.212:43371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=200
--leader_failure_max_missed_heartbeat_periods=3 with env {}
W20260806 15:56:28.487138 19800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:28.487387 19800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:28.487422 19800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:28.491472 19800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:28.491556 19800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.193
I20260806 15:56:28.496366 19800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:43371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=200
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42179
--never_fsync=true
--heap_profile_path=/tmp/kudu.19800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.193
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:28.497512 19800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:28.499058 19800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:28.508821 19805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:28.509019 19800 server_base.cc:1034] running on GCE node
W20260806 15:56:28.508872 19808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:28.508821 19806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:28.509655 19800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:28.510392 19800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:28.511601 19800 hybrid_clock.cc:648] HybridClock initialized: now 1786031788511587 us; error 30 us; skew 500 ppm
I20260806 15:56:28.513484 19800 webserver.cc:460] Webserver started at http://127.10.189.193:42387/ using document root <none> and password file <none>
I20260806 15:56:28.514119 19800 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:28.514222 19800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:28.514464 19800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:28.516324 19800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "ee7c8f5116f44a5d82e83fe37eb5b234"
format_stamp: "Formatted at 2026-08-06 15:56:28 on dist-test-slave-mn4r"
I20260806 15:56:28.516884 19800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "ee7c8f5116f44a5d82e83fe37eb5b234"
format_stamp: "Formatted at 2026-08-06 15:56:28 on dist-test-slave-mn4r"
I20260806 15:56:28.520527 19800 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 15:56:28.522890 19815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:28.524031 19800 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 15:56:28.524165 19800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "ee7c8f5116f44a5d82e83fe37eb5b234"
format_stamp: "Formatted at 2026-08-06 15:56:28 on dist-test-slave-mn4r"
I20260806 15:56:28.524273 19800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:28.538172 19800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:28.538817 19800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:28.539023 19800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:28.539616 19800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:28.540565 19800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:28.540637 19800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:28.540711 19800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:28.540755 19800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:28.549662 19800 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.193:44523
I20260806 15:56:28.549712 19930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.193:44523 every 8 connection(s)
I20260806 15:56:28.550565 19800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260806 15:56:28.559540 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 19800
I20260806 15:56:28.559664 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260806 15:56:28.561267 19931 heartbeater.cc:347] Connected to a master server at 127.10.189.254:42179
I20260806 15:56:28.561537 19931 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:28.562132 19931 heartbeater.cc:511] Master 127.10.189.254:42179 requested a full tablet report, sending...
I20260806 15:56:28.562168 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.194:0
--local_ip_for_outbound_sockets=127.10.189.194
--webserver_interface=127.10.189.194
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42179
--builtin_ntp_servers=127.10.189.212:43371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=200
--leader_failure_max_missed_heartbeat_periods=3 with env {}
I20260806 15:56:28.563673 19737 ts_manager.cc:194] Registered new tserver with Master: ee7c8f5116f44a5d82e83fe37eb5b234 (127.10.189.193:44523)
I20260806 15:56:28.564807 19737 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.193:35545
W20260806 15:56:28.673857 19934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:28.674160 19934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:28.674269 19934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:28.678356 19934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:28.678444 19934 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.194
I20260806 15:56:28.683249 19934 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:43371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=200
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.10.189.194
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42179
--never_fsync=true
--heap_profile_path=/tmp/kudu.19934
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.194
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:28.684293 19934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:28.685671 19934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:28.695147 19939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:28.695160 19942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:28.695135 19940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:28.695516 19934 server_base.cc:1034] running on GCE node
I20260806 15:56:28.695961 19934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:28.696588 19934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:28.697745 19934 hybrid_clock.cc:648] HybridClock initialized: now 1786031788697711 us; error 48 us; skew 500 ppm
I20260806 15:56:28.699666 19934 webserver.cc:460] Webserver started at http://127.10.189.194:45373/ using document root <none> and password file <none>
I20260806 15:56:28.700228 19934 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:28.700292 19934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:28.700510 19934 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:28.702435 19934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "6013058cd4794188b125923f1643483b"
format_stamp: "Formatted at 2026-08-06 15:56:28 on dist-test-slave-mn4r"
I20260806 15:56:28.702989 19934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "6013058cd4794188b125923f1643483b"
format_stamp: "Formatted at 2026-08-06 15:56:28 on dist-test-slave-mn4r"
I20260806 15:56:28.706554 19934 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 15:56:28.708931 19948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:28.710295 19934 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 15:56:28.710422 19934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "6013058cd4794188b125923f1643483b"
format_stamp: "Formatted at 2026-08-06 15:56:28 on dist-test-slave-mn4r"
I20260806 15:56:28.710536 19934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:28.722059 19934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:28.722826 19934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:28.723032 19934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:28.723641 19934 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:28.724610 19934 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:28.724684 19934 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:28.724752 19934 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:28.724802 19934 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:28.734002 19934 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.194:32877
I20260806 15:56:28.734140 20065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.194:32877 every 8 connection(s)
I20260806 15:56:28.734961 19934 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260806 15:56:28.738942 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 19934
I20260806 15:56:28.739077 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260806 15:56:28.741430 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.195:0
--local_ip_for_outbound_sockets=127.10.189.195
--webserver_interface=127.10.189.195
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42179
--builtin_ntp_servers=127.10.189.212:43371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=200
--leader_failure_max_missed_heartbeat_periods=3 with env {}
I20260806 15:56:28.746204 20066 heartbeater.cc:347] Connected to a master server at 127.10.189.254:42179
I20260806 15:56:28.746434 20066 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:28.746948 20066 heartbeater.cc:511] Master 127.10.189.254:42179 requested a full tablet report, sending...
I20260806 15:56:28.747993 19737 ts_manager.cc:194] Registered new tserver with Master: 6013058cd4794188b125923f1643483b (127.10.189.194:32877)
I20260806 15:56:28.748569 19737 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.194:48327
W20260806 15:56:28.855849 20069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:28.856133 20069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:28.856201 20069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:28.860255 20069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:28.860397 20069 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.195
I20260806 15:56:28.865363 20069 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:43371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=200
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.189.195
--webserver_port=0
--tserver_master_addrs=127.10.189.254:42179
--never_fsync=true
--heap_profile_path=/tmp/kudu.20069
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.195
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:28.866612 20069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:28.868039 20069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:28.877758 20077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:28.877758 20075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:28.877733 20074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:28.877959 20069 server_base.cc:1034] running on GCE node
I20260806 15:56:28.878527 20069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:28.879170 20069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:28.880354 20069 hybrid_clock.cc:648] HybridClock initialized: now 1786031788880341 us; error 24 us; skew 500 ppm
I20260806 15:56:28.882298 20069 webserver.cc:460] Webserver started at http://127.10.189.195:43183/ using document root <none> and password file <none>
I20260806 15:56:28.882869 20069 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:28.882969 20069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:28.883203 20069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:28.885068 20069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "6d939c1e7aa1433c9561757487dddaaa"
format_stamp: "Formatted at 2026-08-06 15:56:28 on dist-test-slave-mn4r"
I20260806 15:56:28.885618 20069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "6d939c1e7aa1433c9561757487dddaaa"
format_stamp: "Formatted at 2026-08-06 15:56:28 on dist-test-slave-mn4r"
I20260806 15:56:28.889286 20069 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.001s
I20260806 15:56:28.891711 20083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:28.892894 20069 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 15:56:28.893035 20069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "6d939c1e7aa1433c9561757487dddaaa"
format_stamp: "Formatted at 2026-08-06 15:56:28 on dist-test-slave-mn4r"
I20260806 15:56:28.893141 20069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:28.915781 20069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:28.916452 20069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:28.916639 20069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:28.917229 20069 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:28.918239 20069 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:28.918308 20069 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:28.918377 20069 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:28.918432 20069 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:28.927019 20069 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.195:44741
I20260806 15:56:28.927042 20199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.195:44741 every 8 connection(s)
I20260806 15:56:28.928006 20069 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260806 15:56:28.928869 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 20069
I20260806 15:56:28.928984 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260806 15:56:28.938500 20200 heartbeater.cc:347] Connected to a master server at 127.10.189.254:42179
I20260806 15:56:28.938710 20200 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:28.939165 20200 heartbeater.cc:511] Master 127.10.189.254:42179 requested a full tablet report, sending...
I20260806 15:56:28.940124 19737 ts_manager.cc:194] Registered new tserver with Master: 6d939c1e7aa1433c9561757487dddaaa (127.10.189.195:44741)
I20260806 15:56:28.940691 19737 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.195:37771
I20260806 15:56:28.943209 10999 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:56:28.951701 19737 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50638:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
W20260806 15:56:28.954802 19737 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:56:28.972558 20132 tablet_service.cc:1467] Processing CreateTablet for tablet 72dbee3fed954855aece3a9ee10a22d2 (DEFAULT_TABLE table=TestTable [id=b07e11ee48e94a1b9fae9a1097861806]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:28.972594 19997 tablet_service.cc:1467] Processing CreateTablet for tablet 72dbee3fed954855aece3a9ee10a22d2 (DEFAULT_TABLE table=TestTable [id=b07e11ee48e94a1b9fae9a1097861806]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:28.972594 19864 tablet_service.cc:1467] Processing CreateTablet for tablet 72dbee3fed954855aece3a9ee10a22d2 (DEFAULT_TABLE table=TestTable [id=b07e11ee48e94a1b9fae9a1097861806]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:56:28.973583 20132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72dbee3fed954855aece3a9ee10a22d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:28.973605 19864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72dbee3fed954855aece3a9ee10a22d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:28.973606 19997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72dbee3fed954855aece3a9ee10a22d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:28.979298 20218 tablet_bootstrap.cc:492] T 72dbee3fed954855aece3a9ee10a22d2 P 6d939c1e7aa1433c9561757487dddaaa: Bootstrap starting.
I20260806 15:56:28.981132 20220 tablet_bootstrap.cc:492] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234: Bootstrap starting.
I20260806 15:56:28.982420 20219 tablet_bootstrap.cc:492] T 72dbee3fed954855aece3a9ee10a22d2 P 6013058cd4794188b125923f1643483b: Bootstrap starting.
I20260806 15:56:28.982591 20218 tablet_bootstrap.cc:654] T 72dbee3fed954855aece3a9ee10a22d2 P 6d939c1e7aa1433c9561757487dddaaa: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:28.983130 20220 tablet_bootstrap.cc:654] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:28.983357 20218 log.cc:824] T 72dbee3fed954855aece3a9ee10a22d2 P 6d939c1e7aa1433c9561757487dddaaa: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:28.983981 20220 log.cc:824] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:28.984522 20219 tablet_bootstrap.cc:654] T 72dbee3fed954855aece3a9ee10a22d2 P 6013058cd4794188b125923f1643483b: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:28.985147 20218 tablet_bootstrap.cc:492] T 72dbee3fed954855aece3a9ee10a22d2 P 6d939c1e7aa1433c9561757487dddaaa: No bootstrap required, opened a new log
I20260806 15:56:28.985291 20219 log.cc:824] T 72dbee3fed954855aece3a9ee10a22d2 P 6013058cd4794188b125923f1643483b: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:28.985355 20218 ts_tablet_manager.cc:1397] T 72dbee3fed954855aece3a9ee10a22d2 P 6d939c1e7aa1433c9561757487dddaaa: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 15:56:28.985905 20220 tablet_bootstrap.cc:492] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234: No bootstrap required, opened a new log
I20260806 15:56:28.986083 20220 ts_tablet_manager.cc:1397] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260806 15:56:28.987638 20219 tablet_bootstrap.cc:492] T 72dbee3fed954855aece3a9ee10a22d2 P 6013058cd4794188b125923f1643483b: No bootstrap required, opened a new log
I20260806 15:56:28.987831 20219 ts_tablet_manager.cc:1397] T 72dbee3fed954855aece3a9ee10a22d2 P 6013058cd4794188b125923f1643483b: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260806 15:56:28.989207 20218 raft_consensus.cc:348] T 72dbee3fed954855aece3a9ee10a22d2 P 6d939c1e7aa1433c9561757487dddaaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6013058cd4794188b125923f1643483b" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 32877 } } peers { permanent_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 44523 } } peers { permanent_uuid: "6d939c1e7aa1433c9561757487dddaaa" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 44741 } }
I20260806 15:56:28.989456 20218 raft_consensus.cc:374] T 72dbee3fed954855aece3a9ee10a22d2 P 6d939c1e7aa1433c9561757487dddaaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:56:28.989511 20218 raft_consensus.cc:729] T 72dbee3fed954855aece3a9ee10a22d2 P 6d939c1e7aa1433c9561757487dddaaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d939c1e7aa1433c9561757487dddaaa, State: Initialized, Role: FOLLOWER
I20260806 15:56:28.989976 20218 consensus_queue.cc:260] T 72dbee3fed954855aece3a9ee10a22d2 P 6d939c1e7aa1433c9561757487dddaaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6013058cd4794188b125923f1643483b" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 32877 } } peers { permanent_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 44523 } } peers { permanent_uuid: "6d939c1e7aa1433c9561757487dddaaa" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 44741 } }
I20260806 15:56:28.990469 20220 raft_consensus.cc:348] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6013058cd4794188b125923f1643483b" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 32877 } } peers { permanent_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 44523 } } peers { permanent_uuid: "6d939c1e7aa1433c9561757487dddaaa" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 44741 } }
I20260806 15:56:28.990634 20200 heartbeater.cc:503] Master 127.10.189.254:42179 was elected leader, sending a full tablet report...
I20260806 15:56:28.990705 20220 raft_consensus.cc:374] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:56:28.990758 20220 raft_consensus.cc:729] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee7c8f5116f44a5d82e83fe37eb5b234, State: Initialized, Role: FOLLOWER
I20260806 15:56:28.990998 20218 ts_tablet_manager.cc:1428] T 72dbee3fed954855aece3a9ee10a22d2 P 6d939c1e7aa1433c9561757487dddaaa: Time spent starting tablet: real 0.005s user 0.001s sys 0.003s
I20260806 15:56:28.991206 20220 consensus_queue.cc:260] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6013058cd4794188b125923f1643483b" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 32877 } } peers { permanent_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 44523 } } peers { permanent_uuid: "6d939c1e7aa1433c9561757487dddaaa" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 44741 } }
I20260806 15:56:28.991894 19931 heartbeater.cc:503] Master 127.10.189.254:42179 was elected leader, sending a full tablet report...
I20260806 15:56:28.991991 20219 raft_consensus.cc:348] T 72dbee3fed954855aece3a9ee10a22d2 P 6013058cd4794188b125923f1643483b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6013058cd4794188b125923f1643483b" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 32877 } } peers { permanent_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 44523 } } peers { permanent_uuid: "6d939c1e7aa1433c9561757487dddaaa" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 44741 } }
I20260806 15:56:28.992169 20220 ts_tablet_manager.cc:1428] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260806 15:56:28.992211 20219 raft_consensus.cc:374] T 72dbee3fed954855aece3a9ee10a22d2 P 6013058cd4794188b125923f1643483b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:56:28.992259 20219 raft_consensus.cc:729] T 72dbee3fed954855aece3a9ee10a22d2 P 6013058cd4794188b125923f1643483b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6013058cd4794188b125923f1643483b, State: Initialized, Role: FOLLOWER
I20260806 15:56:28.992643 20219 consensus_queue.cc:260] T 72dbee3fed954855aece3a9ee10a22d2 P 6013058cd4794188b125923f1643483b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6013058cd4794188b125923f1643483b" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 32877 } } peers { permanent_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 44523 } } peers { permanent_uuid: "6d939c1e7aa1433c9561757487dddaaa" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 44741 } }
I20260806 15:56:28.993590 20219 ts_tablet_manager.cc:1428] T 72dbee3fed954855aece3a9ee10a22d2 P 6013058cd4794188b125923f1643483b: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 15:56:28.993703 20066 heartbeater.cc:503] Master 127.10.189.254:42179 was elected leader, sending a full tablet report...
W20260806 15:56:29.051780 19932 tablet.cc:2369] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:56:29.115535 20225 raft_consensus.cc:482] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:56:29.115736 20225 raft_consensus.cc:504] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6013058cd4794188b125923f1643483b" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 32877 } } peers { permanent_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 44523 } } peers { permanent_uuid: "6d939c1e7aa1433c9561757487dddaaa" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 44741 } }
I20260806 15:56:29.116837 20225 leader_election.cc:288] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6013058cd4794188b125923f1643483b (127.10.189.194:32877), 6d939c1e7aa1433c9561757487dddaaa (127.10.189.195:44741)
I20260806 15:56:29.121224 20017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6013058cd4794188b125923f1643483b" is_pre_election: true
I20260806 15:56:29.121335 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: true
I20260806 15:56:29.121568 20152 raft_consensus.cc:2454] T 72dbee3fed954855aece3a9ee10a22d2 P 6d939c1e7aa1433c9561757487dddaaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee7c8f5116f44a5d82e83fe37eb5b234 in term 0.
I20260806 15:56:29.121567 20017 raft_consensus.cc:2454] T 72dbee3fed954855aece3a9ee10a22d2 P 6013058cd4794188b125923f1643483b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee7c8f5116f44a5d82e83fe37eb5b234 in term 0.
I20260806 15:56:29.122063 19818 leader_election.cc:302] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d939c1e7aa1433c9561757487dddaaa, ee7c8f5116f44a5d82e83fe37eb5b234; no voters:
I20260806 15:56:29.122372 20225 raft_consensus.cc:2781] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:56:29.122462 20225 raft_consensus.cc:482] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:56:29.122495 20225 raft_consensus.cc:3037] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:29.123509 20225 raft_consensus.cc:504] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6013058cd4794188b125923f1643483b" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 32877 } } peers { permanent_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 44523 } } peers { permanent_uuid: "6d939c1e7aa1433c9561757487dddaaa" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 44741 } }
I20260806 15:56:29.123855 20225 leader_election.cc:288] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 [CANDIDATE]: Term 1 election: Requested vote from peers 6013058cd4794188b125923f1643483b (127.10.189.194:32877), 6d939c1e7aa1433c9561757487dddaaa (127.10.189.195:44741)
I20260806 15:56:29.124210 20017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6013058cd4794188b125923f1643483b"
I20260806 15:56:29.124217 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa"
I20260806 15:56:29.124315 20017 raft_consensus.cc:3037] T 72dbee3fed954855aece3a9ee10a22d2 P 6013058cd4794188b125923f1643483b [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:29.124346 20152 raft_consensus.cc:3037] T 72dbee3fed954855aece3a9ee10a22d2 P 6d939c1e7aa1433c9561757487dddaaa [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:29.125303 20152 raft_consensus.cc:2454] T 72dbee3fed954855aece3a9ee10a22d2 P 6d939c1e7aa1433c9561757487dddaaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee7c8f5116f44a5d82e83fe37eb5b234 in term 1.
I20260806 15:56:29.125313 20017 raft_consensus.cc:2454] T 72dbee3fed954855aece3a9ee10a22d2 P 6013058cd4794188b125923f1643483b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee7c8f5116f44a5d82e83fe37eb5b234 in term 1.
I20260806 15:56:29.125633 19818 leader_election.cc:302] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d939c1e7aa1433c9561757487dddaaa, ee7c8f5116f44a5d82e83fe37eb5b234; no voters:
I20260806 15:56:29.125811 20225 raft_consensus.cc:2781] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:29.126144 20225 raft_consensus.cc:686] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 [term 1 LEADER]: Becoming Leader. State: Replica: ee7c8f5116f44a5d82e83fe37eb5b234, State: Running, Role: LEADER
I20260806 15:56:29.126493 20225 consensus_queue.cc:237] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6013058cd4794188b125923f1643483b" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 32877 } } peers { permanent_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 44523 } } peers { permanent_uuid: "6d939c1e7aa1433c9561757487dddaaa" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 44741 } }
I20260806 15:56:29.129730 19736 catalog_manager.cc:5495] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee7c8f5116f44a5d82e83fe37eb5b234 (127.10.189.193). New cstate: current_term: 1 leader_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6013058cd4794188b125923f1643483b" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 32877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 44523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d939c1e7aa1433c9561757487dddaaa" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 44741 } health_report { overall_health: UNKNOWN } } }
I20260806 15:56:29.154115 10999 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:56:29.155503 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver ee7c8f5116f44a5d82e83fe37eb5b234 to finish bootstrapping
I20260806 15:56:29.161394 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 6013058cd4794188b125923f1643483b to finish bootstrapping
I20260806 15:56:29.166698 10999 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 6d939c1e7aa1433c9561757487dddaaa to finish bootstrapping
I20260806 15:56:29.172591 19924 generic_service.cc:175] {username='slave'} at 127.0.0.1:42034 changed flags via RPC: log_inject_latency from 'false' to 'false'
I20260806 15:56:29.173629 20059 generic_service.cc:175] {username='slave'} at 127.0.0.1:42702 changed flags via RPC: log_inject_latency from 'false' to 'false'
I20260806 15:56:29.174589 20193 generic_service.cc:175] {username='slave'} at 127.0.0.1:47496 changed flags via RPC: log_inject_latency from 'false' to 'false'
W20260806 15:56:29.179077 20201 tablet.cc:2369] T 72dbee3fed954855aece3a9ee10a22d2 P 6d939c1e7aa1433c9561757487dddaaa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:56:29.186185 20152 raft_consensus.cc:1261] T 72dbee3fed954855aece3a9ee10a22d2 P 6d939c1e7aa1433c9561757487dddaaa [term 1 FOLLOWER]: Refusing update from remote peer ee7c8f5116f44a5d82e83fe37eb5b234: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:56:29.186208 20017 raft_consensus.cc:1261] T 72dbee3fed954855aece3a9ee10a22d2 P 6013058cd4794188b125923f1643483b [term 1 FOLLOWER]: Refusing update from remote peer ee7c8f5116f44a5d82e83fe37eb5b234: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:56:29.186899 20229 consensus_queue.cc:1035] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6013058cd4794188b125923f1643483b" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 32877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:56:29.187140 20225 consensus_queue.cc:1035] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d939c1e7aa1433c9561757487dddaaa" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 44741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:56:29.193807 20233 mvcc.cc:205] Tried to move back new op lower bound from 7315586208499818496 to 7315586208264892416. Current Snapshot: MvccSnapshot[applied={T|T < 7315586208499818496}]
I20260806 15:56:29.194824 20234 mvcc.cc:205] Tried to move back new op lower bound from 7315586208499818496 to 7315586208264892416. Current Snapshot: MvccSnapshot[applied={T|T < 7315586208499818496}]
I20260806 15:56:29.208161 20193 generic_service.cc:175] {username='slave'} at 127.0.0.1:47496 changed flags via RPC: log_inject_latency_ms_mean from '100' to '600'
I20260806 15:56:29.208942 20193 generic_service.cc:175] {username='slave'} at 127.0.0.1:47496 changed flags via RPC: log_inject_latency_ms_stddev from '100' to '0'
I20260806 15:56:29.209649 20193 generic_service.cc:175] {username='slave'} at 127.0.0.1:47496 changed flags via RPC: log_inject_latency from 'false' to 'true'
I20260806 15:56:29.210475 19924 generic_service.cc:175] {username='slave'} at 127.0.0.1:42034 changed flags via RPC: log_inject_latency_ms_mean from '100' to '1200'
I20260806 15:56:29.211333 19924 generic_service.cc:175] {username='slave'} at 127.0.0.1:42034 changed flags via RPC: log_inject_latency_ms_stddev from '100' to '0'
I20260806 15:56:29.212108 19924 generic_service.cc:175] {username='slave'} at 127.0.0.1:42034 changed flags via RPC: log_inject_latency from 'false' to 'true'
I20260806 15:56:29.212441 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 19934
I20260806 15:56:29.222343 10999 test_util.cc:268] Using random seed: -296048187
I20260806 15:56:29.231410 10999 test_workload.cc:401] TestWorkload: Skipping table creation because table TestTable already exists
W20260806 15:56:29.240334 20230 log.cc:508] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234: Injecting 1200ms of latency in SegmentAllocator::Sync()
W20260806 15:56:29.240816 19819 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.189.194:32877: connect: Connection refused (error 111)
W20260806 15:56:29.241755 20237 log.cc:508] T 72dbee3fed954855aece3a9ee10a22d2 P 6d939c1e7aa1433c9561757487dddaaa: Injecting 600ms of latency in SegmentAllocator::Sync()
W20260806 15:56:29.241806 19819 consensus_peers.cc:487] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 -> Peer 6013058cd4794188b125923f1643483b (127.10.189.194:32877): Couldn't send request to peer 6013058cd4794188b125923f1643483b. Status: Network error: Client connection negotiation failed: client connection to 127.10.189.194:32877: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 15:56:29.282691 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 2 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:29.284580 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 2 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:29.336076 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 3 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:29.337415 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 3 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:29.389046 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 4 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:29.390365 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 4 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:29.442145 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 5 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:29.443401 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 5 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:29.494998 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 6 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:29.496527 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 6 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:29.547955 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 7 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:29.549221 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 7 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:29.600781 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 8 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:29.602072 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 8 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:29.653680 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 9 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:29.655189 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 9 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:29.706871 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 10 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:29.708149 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 10 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:29.759690 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 11 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:29.761052 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 11 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:29.812731 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 12 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:29.814009 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 12 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:29.865656 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 13 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:29.866963 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 13 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:29.918473 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 14 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:29.919768 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 14 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:29.971357 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 15 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:29.972668 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 15 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:30.024132 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 16 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:30.025431 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 16 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:30.076794 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 17 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:30.078126 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 17 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
W20260806 15:56:30.089025 19819 consensus_peers.cc:487] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 -> Peer 6013058cd4794188b125923f1643483b (127.10.189.194:32877): Couldn't send request to peer 6013058cd4794188b125923f1643483b. Status: Network error: Client connection negotiation failed: client connection to 127.10.189.194:32877: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260806 15:56:30.129675 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 18 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:30.131031 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 18 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:30.182651 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 19 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:30.183931 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 19 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:30.235417 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 20 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:30.236703 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 20 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:30.288172 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 21 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:30.289472 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 21 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:30.341122 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 22 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:30.342507 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 22 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:30.394244 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 23 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:30.395694 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 23 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:30.441927 20250 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:42054 (ReqId={client: 27f2ddae0fae4535832b79b27ef70307, seq_no=0, attempt_no=0}) took 1203 ms. Trace:
I20260806 15:56:30.442101 20250 rpcz_store.cc:276] 0806 15:56:29.238326 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:56:29.238383 (+ 57us) service_pool.cc:227] Handling call
0806 15:56:30.441906 (+1203523us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:56:29.239397 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 72dbee3fed954855aece3a9ee10a22d2
0806 15:56:29.239481 (+ 84us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:56:29.239485 (+ 4us) write_op.cc:435] Acquired schema lock
0806 15:56:29.239486 (+ 1us) tablet.cc:660] Decoding operations
0806 15:56:29.239548 (+ 62us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:56:29.239556 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0806 15:56:29.239558 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:56:29.239588 (+ 30us) tablet.cc:699] Row locks acquired
0806 15:56:29.239589 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:56:29.239696 (+ 107us) write_op.cc:270] Start()
0806 15:56:29.239719 (+ 23us) write_op.cc:276] Timestamp: P: 1786031789239650 usec, L: 0
0806 15:56:29.239721 (+ 2us) op_driver.cc:331] REPLICATION: starting
0806 15:56:29.239907 (+ 186us) log.cc:842] Serialized 345 byte log entry
0806 15:56:30.440943 (+1201036us) op_driver.cc:444] REPLICATION: finished
0806 15:56:30.441250 (+ 307us) write_op.cc:301] APPLY: starting
0806 15:56:30.441268 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:56:30.441297 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0806 15:56:30.441323 (+ 26us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:56:30.441405 (+ 82us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:56:30.441432 (+ 27us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:56:30.441435 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:56:30.441502 (+ 67us) log.cc:842] Serialized 22 byte log entry
0806 15:56:30.441558 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:56:30.441570 (+ 12us) write_op.cc:454] Released schema lock
0806 15:56:30.441575 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":226,"num_ops":1,"prepare.queue_time_us":54,"prepare.run_cpu_time_us":647,"prepare.run_wall_time_us":648,"raft.queue_time_us":128,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":351,"replication_time_us":1201184,"spinlock_wait_cycles":1792,"thread_start_us":113,"threads_started":1}]]}
I20260806 15:56:30.446980 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 24 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:30.448077 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 24 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:30.499562 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 25 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:30.500960 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 25 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:30.552613 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 26 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:30.553913 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 26 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:30.605531 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 27 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:30.606848 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 27 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
W20260806 15:56:30.646418 20230 log.cc:508] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234: Injecting 1200ms of latency in SegmentAllocator::Sync()
W20260806 15:56:30.647629 20237 log.cc:508] T 72dbee3fed954855aece3a9ee10a22d2 P 6d939c1e7aa1433c9561757487dddaaa: Injecting 600ms of latency in SegmentAllocator::Sync()
I20260806 15:56:30.658291 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 28 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:30.659533 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 28 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:30.711117 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 29 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:30.712316 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 29 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:30.763847 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 30 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:30.765082 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 30 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:30.816612 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 31 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:30.817948 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 31 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:30.869597 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 32 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:30.870847 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 32 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:30.922220 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 33 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:30.923465 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 33 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:30.975026 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 34 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:30.976351 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 34 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:31.027776 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 35 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:31.029055 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 35 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:31.080627 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 36 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:31.081995 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 36 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:31.133510 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 37 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
W20260806 15:56:31.133824 19819 consensus_peers.cc:487] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 -> Peer 6013058cd4794188b125923f1643483b (127.10.189.194:32877): Couldn't send request to peer 6013058cd4794188b125923f1643483b. Status: Network error: Client connection negotiation failed: client connection to 127.10.189.194:32877: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260806 15:56:31.134779 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 37 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:31.186326 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 38 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:31.187650 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 38 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:31.239099 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 39 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:31.240351 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 39 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:31.291836 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 40 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:31.293201 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 40 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:31.344789 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 41 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:31.346432 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 41 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:31.398200 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 42 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:31.399734 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 42 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:31.451239 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 43 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:31.452492 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 43 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:31.504034 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 44 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:31.505427 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 44 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:31.556967 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 45 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:31.558185 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 45 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:31.609687 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 46 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:31.610963 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 46 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:31.662529 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 47 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:31.663781 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 47 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:31.715386 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 48 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:31.716723 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 48 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:31.768168 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 49 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:31.769379 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 49 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:31.820823 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 50 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:31.822198 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 50 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:31.847596 20256 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:42054 (ReqId={client: 27f2ddae0fae4535832b79b27ef70307, seq_no=1, attempt_no=0}) took 1202 ms. Trace:
I20260806 15:56:31.847702 20256 rpcz_store.cc:276] 0806 15:56:30.644694 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:56:30.644774 (+ 80us) service_pool.cc:227] Handling call
0806 15:56:31.847564 (+1202790us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:56:30.645692 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 72dbee3fed954855aece3a9ee10a22d2
0806 15:56:30.645781 (+ 89us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:56:30.645784 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:56:30.645785 (+ 1us) tablet.cc:660] Decoding operations
0806 15:56:30.645850 (+ 65us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:56:30.645858 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0806 15:56:30.645860 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:56:30.645893 (+ 33us) tablet.cc:699] Row locks acquired
0806 15:56:30.645893 (+ 0us) write_op.cc:260] PREPARE: finished
0806 15:56:30.645924 (+ 31us) write_op.cc:270] Start()
0806 15:56:30.645947 (+ 23us) write_op.cc:276] Timestamp: P: 1786031790645888 usec, L: 0
0806 15:56:30.645948 (+ 1us) op_driver.cc:331] REPLICATION: starting
0806 15:56:30.646121 (+ 173us) log.cc:842] Serialized 354 byte log entry
0806 15:56:31.846888 (+1200767us) op_driver.cc:444] REPLICATION: finished
0806 15:56:31.847147 (+ 259us) write_op.cc:301] APPLY: starting
0806 15:56:31.847164 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0806 15:56:31.847193 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0806 15:56:31.847208 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:56:31.847263 (+ 55us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:56:31.847288 (+ 25us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:56:31.847291 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:56:31.847353 (+ 62us) log.cc:842] Serialized 22 byte log entry
0806 15:56:31.847460 (+ 107us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:56:31.847476 (+ 16us) write_op.cc:454] Released schema lock
0806 15:56:31.847483 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":186,"num_ops":1,"prepare.queue_time_us":220,"prepare.run_cpu_time_us":548,"prepare.run_wall_time_us":549,"raft.queue_time_us":157,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":215,"replication_time_us":1200912,"thread_start_us":187,"threads_started":2}]]}
I20260806 15:56:31.873739 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 51 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:31.875032 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 51 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:31.926584 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 52 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:31.927947 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 52 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:31.979488 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 53 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:31.980785 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 53 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:32.032176 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 54 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:32.033656 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 54 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
W20260806 15:56:32.050812 20230 log.cc:508] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234: Injecting 1200ms of latency in SegmentAllocator::Sync()
W20260806 15:56:32.052081 20237 log.cc:508] T 72dbee3fed954855aece3a9ee10a22d2 P 6d939c1e7aa1433c9561757487dddaaa: Injecting 600ms of latency in SegmentAllocator::Sync()
I20260806 15:56:32.085355 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 55 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:32.086730 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 55 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:32.138253 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 56 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:32.139533 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 56 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:32.191098 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 57 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:32.192386 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 57 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
W20260806 15:56:32.214179 19819 consensus_peers.cc:487] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 -> Peer 6013058cd4794188b125923f1643483b (127.10.189.194:32877): Couldn't send request to peer 6013058cd4794188b125923f1643483b. Status: Network error: Client connection negotiation failed: client connection to 127.10.189.194:32877: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260806 15:56:32.243841 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 58 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:32.245152 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 58 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:32.296617 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 59 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:32.297930 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 59 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:32.349327 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 60 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:32.350812 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 60 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:32.402165 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 61 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:32.403375 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 61 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:32.454877 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 62 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:32.456166 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 62 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:32.507721 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 63 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:32.509121 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 63 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:32.560511 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 64 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:32.561793 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 64 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:32.613408 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 65 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:32.614768 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 65 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:32.666277 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 66 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:32.667532 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 66 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:32.719095 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 67 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:32.720307 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 67 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:32.771849 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 68 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:32.773140 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 68 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:32.824695 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 69 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:32.826067 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 69 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:32.877689 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 70 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:32.879293 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 70 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:32.930913 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 71 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:32.932334 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 71 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:32.983959 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 72 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:32.985251 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 72 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:33.036651 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 73 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:33.037895 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 73 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:33.089375 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 74 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:33.090602 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 74 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:33.142261 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 75 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:33.143580 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 75 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:33.195220 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 76 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:33.196506 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 76 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
W20260806 15:56:33.242779 19819 consensus_peers.cc:487] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 -> Peer 6013058cd4794188b125923f1643483b (127.10.189.194:32877): Couldn't send request to peer 6013058cd4794188b125923f1643483b. Status: Network error: Client connection negotiation failed: client connection to 127.10.189.194:32877: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260806 15:56:33.247802 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 77 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:33.248973 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 77 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:33.251917 20262 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:42054 (ReqId={client: 27f2ddae0fae4535832b79b27ef70307, seq_no=2, attempt_no=0}) took 1202 ms. Trace:
I20260806 15:56:33.252010 20262 rpcz_store.cc:276] 0806 15:56:32.049338 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:56:32.049413 (+ 75us) service_pool.cc:227] Handling call
0806 15:56:33.251902 (+1202489us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:56:32.050046 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 72dbee3fed954855aece3a9ee10a22d2
0806 15:56:32.050155 (+ 109us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:56:32.050158 (+ 3us) write_op.cc:435] Acquired schema lock
0806 15:56:32.050160 (+ 2us) tablet.cc:660] Decoding operations
0806 15:56:32.050225 (+ 65us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:56:32.050233 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0806 15:56:32.050235 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:56:32.050267 (+ 32us) tablet.cc:699] Row locks acquired
0806 15:56:32.050268 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:56:32.050300 (+ 32us) write_op.cc:270] Start()
0806 15:56:32.050323 (+ 23us) write_op.cc:276] Timestamp: P: 1786031792050235 usec, L: 0
0806 15:56:32.050324 (+ 1us) op_driver.cc:331] REPLICATION: starting
0806 15:56:32.050467 (+ 143us) log.cc:842] Serialized 354 byte log entry
0806 15:56:33.251275 (+1200808us) op_driver.cc:444] REPLICATION: finished
0806 15:56:33.251512 (+ 237us) write_op.cc:301] APPLY: starting
0806 15:56:33.251528 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0806 15:56:33.251557 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0806 15:56:33.251567 (+ 10us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:56:33.251620 (+ 53us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:56:33.251644 (+ 24us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:56:33.251647 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:56:33.251727 (+ 80us) log.cc:842] Serialized 22 byte log entry
0806 15:56:33.251802 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:56:33.251821 (+ 19us) write_op.cc:454] Released schema lock
0806 15:56:33.251828 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":182,"num_ops":1,"prepare.queue_time_us":209,"prepare.run_cpu_time_us":576,"prepare.run_wall_time_us":576,"raft.queue_time_us":215,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":178,"replication_time_us":1200928,"thread_start_us":177,"threads_started":2}]]}
I20260806 15:56:33.300556 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 78 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:33.302112 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 78 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:33.353688 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 79 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:33.354946 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 79 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:33.406329 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 80 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:33.407590 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 80 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
W20260806 15:56:33.455317 20230 log.cc:508] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234: Injecting 1200ms of latency in SegmentAllocator::Sync()
W20260806 15:56:33.456506 20237 log.cc:508] T 72dbee3fed954855aece3a9ee10a22d2 P 6d939c1e7aa1433c9561757487dddaaa: Injecting 600ms of latency in SegmentAllocator::Sync()
I20260806 15:56:33.458926 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 81 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:33.460135 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 81 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:33.511696 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 82 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:33.513083 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 82 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:33.564613 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 83 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:33.565912 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 83 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:33.617367 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 84 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:33.618682 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 84 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:33.670234 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 85 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:33.671535 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 85 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:33.723064 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 86 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:33.724336 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 86 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:33.775822 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 87 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:33.777055 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 87 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:33.828401 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 88 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:33.829674 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 88 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:33.881259 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 89 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:33.882637 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 89 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:33.934154 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 90 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:33.935349 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 90 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:33.986914 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 91 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:33.988215 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 91 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:34.039739 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 92 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:34.041119 20152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 92 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:34.092605 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 93 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:34.093926 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 93 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:34.145514 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 94 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:34.146880 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 94 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
W20260806 15:56:34.174671 19819 consensus_peers.cc:487] T 72dbee3fed954855aece3a9ee10a22d2 P ee7c8f5116f44a5d82e83fe37eb5b234 -> Peer 6013058cd4794188b125923f1643483b (127.10.189.194:32877): Couldn't send request to peer 6013058cd4794188b125923f1643483b. Status: Network error: Client connection negotiation failed: client connection to 127.10.189.194:32877: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260806 15:56:34.198347 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 95 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:34.199666 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 95 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:34.251269 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 96 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:34.252750 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 96 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:34.304210 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 97 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:34.305593 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 97 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:34.357064 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 98 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:34.358407 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 98 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:34.409631 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 99 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:34.410884 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 99 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
W20260806 15:56:34.414357 19819 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.189.194:32877: connect: Connection refused (error 111) [suppressed 25 similar messages]
I20260806 15:56:34.462136 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 100 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:34.463295 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 100 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:34.514840 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 101 index: 0 } } ignore_live_leader: false dest_uuid: "ee7c8f5116f44a5d82e83fe37eb5b234" is_pre_election: false
I20260806 15:56:34.516155 20151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72dbee3fed954855aece3a9ee10a22d2" candidate_uuid: "6013058cd4794188b125923f1643483b" candidate_term: 2 candidate_status { last_received { term: 101 index: 0 } } ignore_live_leader: false dest_uuid: "6d939c1e7aa1433c9561757487dddaaa" is_pre_election: false
I20260806 15:56:34.656672 20268 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:42054 (ReqId={client: 27f2ddae0fae4535832b79b27ef70307, seq_no=3, attempt_no=0}) took 1202 ms. Trace:
I20260806 15:56:34.656774 20268 rpcz_store.cc:276] 0806 15:56:33.453743 (+ 0us) service_pool.cc:170] Inserting onto call queue
0806 15:56:33.453838 (+ 95us) service_pool.cc:227] Handling call
0806 15:56:34.656629 (+1202791us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0806 15:56:33.454551 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 72dbee3fed954855aece3a9ee10a22d2
0806 15:56:33.454643 (+ 92us) write_op.cc:432] Acquiring schema lock in shared mode
0806 15:56:33.454648 (+ 5us) write_op.cc:435] Acquired schema lock
0806 15:56:33.454649 (+ 1us) tablet.cc:660] Decoding operations
0806 15:56:33.454719 (+ 70us) write_op.cc:620] Acquiring the partition lock for write op
0806 15:56:33.454727 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0806 15:56:33.454729 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
0806 15:56:33.454763 (+ 34us) tablet.cc:699] Row locks acquired
0806 15:56:33.454764 (+ 1us) write_op.cc:260] PREPARE: finished
0806 15:56:33.454798 (+ 34us) write_op.cc:270] Start()
0806 15:56:33.454822 (+ 24us) write_op.cc:276] Timestamp: P: 1786031793454749 usec, L: 0
0806 15:56:33.454823 (+ 1us) op_driver.cc:331] REPLICATION: starting
0806 15:56:33.454979 (+ 156us) log.cc:842] Serialized 354 byte log entry
0806 15:56:34.655897 (+1200918us) op_driver.cc:444] REPLICATION: finished
0806 15:56:34.656201 (+ 304us) write_op.cc:301] APPLY: starting
0806 15:56:34.656219 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0806 15:56:34.656248 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0806 15:56:34.656267 (+ 19us) tablet.cc:1370] starting ApplyRowOperation cycle
0806 15:56:34.656327 (+ 60us) tablet.cc:1381] finished ApplyRowOperation cycle
0806 15:56:34.656353 (+ 26us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0806 15:56:34.656356 (+ 3us) write_op.cc:312] APPLY: finished
0806 15:56:34.656421 (+ 65us) log.cc:842] Serialized 22 byte log entry
0806 15:56:34.656520 (+ 99us) write_op.cc:489] Releasing partition, row and schema locks
0806 15:56:34.656535 (+ 15us) write_op.cc:454] Released schema lock
0806 15:56:34.656542 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":234,"num_ops":1,"prepare.queue_time_us":222,"prepare.run_cpu_time_us":613,"prepare.run_wall_time_us":615,"raft.queue_time_us":226,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":190,"replication_time_us":1201038,"thread_start_us":183,"threads_started":2}]]}
I20260806 15:56:34.858601 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 19800
I20260806 15:56:34.867668 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 20069
I20260806 15:56:34.873787 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 19707
2026-08-06T15:56:34Z chronyd exiting
[ OK ] RaftConsensusElectionITest.DisruptiveServerAndSlowWAL (6770 ms)
[----------] 12 tests from RaftConsensusElectionITest (168752 ms total)
[----------] 2 tests from NumReplicas/RaftConsensusNumLeadersMetricTest
[ RUN ] NumReplicas/RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric/0
I20260806 15:56:34.895920 10999 test_util.cc:268] Using random seed: -290374614
I20260806 15:56:34.896698 10999 ts_itest-base.cc:112] Starting cluster with:
I20260806 15:56:34.896741 10999 ts_itest-base.cc:113] --------------
I20260806 15:56:34.896754 10999 ts_itest-base.cc:114] 1 tablet servers
I20260806 15:56:34.896764 10999 ts_itest-base.cc:115] 3 replicas per TS
I20260806 15:56:34.896800 10999 ts_itest-base.cc:116] --------------
2026-08-06T15:56:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:56:34Z Disabled control of system clock
I20260806 15:56:34.906371 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:35947
--webserver_interface=127.10.189.254
--webserver_port=0
--builtin_ntp_servers=127.10.189.212:38615
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.189.254:35947
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260806 15:56:35.014824 20280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:35.015131 20280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:35.015193 20280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:35.019207 20280 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:56:35.019299 20280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:35.019335 20280 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:56:35.019368 20280 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:56:35.024284 20280 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:38615
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.10.189.254:35947
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:35947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.10.189.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.20280
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:35.025405 20280 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:35.026836 20280 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:35.035825 20288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:35.035820 20286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:35.035925 20280 server_base.cc:1034] running on GCE node
W20260806 15:56:35.035887 20285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:35.036638 20280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:35.037762 20280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:35.038939 20280 hybrid_clock.cc:648] HybridClock initialized: now 1786031795038913 us; error 32 us; skew 500 ppm
I20260806 15:56:35.048882 20280 webserver.cc:460] Webserver started at http://127.10.189.254:39611/ using document root <none> and password file <none>
I20260806 15:56:35.049453 20280 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:35.049516 20280 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:35.049682 20280 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:35.051710 20280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "5120776cc96b425db4888fdd5cfae10f"
format_stamp: "Formatted at 2026-08-06 15:56:35 on dist-test-slave-mn4r"
I20260806 15:56:35.052233 20280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "5120776cc96b425db4888fdd5cfae10f"
format_stamp: "Formatted at 2026-08-06 15:56:35 on dist-test-slave-mn4r"
I20260806 15:56:35.056404 20280 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 15:56:35.058681 20295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:35.059865 20280 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 15:56:35.060043 20280 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
uuid: "5120776cc96b425db4888fdd5cfae10f"
format_stamp: "Formatted at 2026-08-06 15:56:35 on dist-test-slave-mn4r"
I20260806 15:56:35.060150 20280 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:35.069293 20280 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:35.069931 20280 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:35.070194 20280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:35.077103 20280 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.254:35947
I20260806 15:56:35.077119 20349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.254:35947 every 8 connection(s)
I20260806 15:56:35.078114 20280 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260806 15:56:35.081248 20350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:35.082118 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 20280
I20260806 15:56:35.082249 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260806 15:56:35.086879 20350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f: Bootstrap starting.
I20260806 15:56:35.089051 20350 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:35.089929 20350 log.cc:824] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:35.092094 20350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f: No bootstrap required, opened a new log
I20260806 15:56:35.095664 20350 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5120776cc96b425db4888fdd5cfae10f" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 35947 } }
I20260806 15:56:35.095873 20350 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:56:35.095999 20350 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5120776cc96b425db4888fdd5cfae10f, State: Initialized, Role: FOLLOWER
I20260806 15:56:35.096426 20350 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5120776cc96b425db4888fdd5cfae10f" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 35947 } }
I20260806 15:56:35.096575 20350 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:56:35.096659 20350 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:56:35.096778 20350 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:35.097777 20350 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5120776cc96b425db4888fdd5cfae10f" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 35947 } }
I20260806 15:56:35.098158 20350 leader_election.cc:302] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5120776cc96b425db4888fdd5cfae10f; no voters:
I20260806 15:56:35.098486 20350 leader_election.cc:288] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:56:35.098696 20356 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:35.098973 20356 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f [term 1 LEADER]: Becoming Leader. State: Replica: 5120776cc96b425db4888fdd5cfae10f, State: Running, Role: LEADER
I20260806 15:56:35.099285 20356 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5120776cc96b425db4888fdd5cfae10f" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 35947 } }
I20260806 15:56:35.099776 20350 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:56:35.100943 20357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5120776cc96b425db4888fdd5cfae10f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5120776cc96b425db4888fdd5cfae10f" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 35947 } } }
I20260806 15:56:35.101063 20357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f [sys.catalog]: This master's current role is: LEADER
I20260806 15:56:35.101465 20365 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:56:35.101449 20358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5120776cc96b425db4888fdd5cfae10f. Latest consensus state: current_term: 1 leader_uuid: "5120776cc96b425db4888fdd5cfae10f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5120776cc96b425db4888fdd5cfae10f" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 35947 } } }
I20260806 15:56:35.101681 20358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f [sys.catalog]: This master's current role is: LEADER
I20260806 15:56:35.104687 20365 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:56:35.110414 20365 catalog_manager.cc:1347] Generated new cluster ID: ed2f597766cc4cb09bcfa9b6a145d1be
I20260806 15:56:35.110496 20365 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:56:35.130967 20365 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:56:35.131928 20365 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:56:35.139887 20365 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5120776cc96b425db4888fdd5cfae10f: Generated new TSK 0
I20260806 15:56:35.140576 20365 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:56:35.144833 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.193:0
--local_ip_for_outbound_sockets=127.10.189.193
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:35947
--builtin_ntp_servers=127.10.189.212:38615
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260806 15:56:35.262262 20375 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:56:35.262517 20375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:35.262537 20375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:35.262568 20375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:35.266711 20375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:35.266799 20375 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.193
I20260806 15:56:35.271327 20375 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:38615
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:35947
--never_fsync=true
--heap_profile_path=/tmp/kudu.20375
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.193
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:35.272311 20375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:35.273620 20375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:35.282766 20381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:35.282743 20380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:35.282740 20375 server_base.cc:1034] running on GCE node
W20260806 15:56:35.282747 20383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:35.283329 20375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:35.283927 20375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:35.285090 20375 hybrid_clock.cc:648] HybridClock initialized: now 1786031795285076 us; error 26 us; skew 500 ppm
I20260806 15:56:35.286974 20375 webserver.cc:460] Webserver started at http://127.10.189.193:37529/ using document root <none> and password file <none>
I20260806 15:56:35.287561 20375 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:35.287623 20375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:35.287861 20375 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:35.289710 20375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c"
format_stamp: "Formatted at 2026-08-06 15:56:35 on dist-test-slave-mn4r"
I20260806 15:56:35.290307 20375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c"
format_stamp: "Formatted at 2026-08-06 15:56:35 on dist-test-slave-mn4r"
I20260806 15:56:35.293977 20375 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260806 15:56:35.296353 20390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:35.297603 20375 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 15:56:35.297693 20375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c"
format_stamp: "Formatted at 2026-08-06 15:56:35 on dist-test-slave-mn4r"
I20260806 15:56:35.297809 20375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:35.315099 20375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:35.315737 20375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:35.315918 20375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:35.316481 20375 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:35.317399 20375 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:35.317449 20375 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:35.317512 20375 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:35.317543 20375 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:35.326370 20375 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.193:45221
I20260806 15:56:35.326400 20508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.193:45221 every 8 connection(s)
I20260806 15:56:35.327288 20375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260806 15:56:35.332300 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 20375
I20260806 15:56:35.332427 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260806 15:56:35.338168 20509 heartbeater.cc:347] Connected to a master server at 127.10.189.254:35947
I20260806 15:56:35.338398 20509 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:35.338908 20509 heartbeater.cc:511] Master 127.10.189.254:35947 requested a full tablet report, sending...
I20260806 15:56:35.340348 20310 ts_manager.cc:194] Registered new tserver with Master: f5df3e5f5af148bc9f8cb1c28c8a063c (127.10.189.193:45221)
I20260806 15:56:35.341476 20310 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.193:50571
I20260806 15:56:35.346510 10999 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20260806 15:56:35.357297 10999 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20260806 15:56:35.357379 10999 test_util.cc:268] Using random seed: -289913149
I20260806 15:56:35.367815 20310 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47368:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "<redacted>""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 15:56:35.386910 20433 tablet_service.cc:1467] Processing CreateTablet for tablet c371444095fb4b72b193f87e21cb019d (DEFAULT_TABLE table=test-workload [id=4c5d249156234d82b8e8647252714fe4]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260806 15:56:35.388332 20433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c371444095fb4b72b193f87e21cb019d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:35.386732 20439 tablet_service.cc:1467] Processing CreateTablet for tablet 473f12b24ec2473f95c293d29682c9bc (DEFAULT_TABLE table=test-workload [id=4c5d249156234d82b8e8647252714fe4]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260806 15:56:35.389173 20439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 473f12b24ec2473f95c293d29682c9bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:35.389285 20435 tablet_service.cc:1467] Processing CreateTablet for tablet 33dca6dc67804a7c85debbf4a19e13e6 (DEFAULT_TABLE table=test-workload [id=4c5d249156234d82b8e8647252714fe4]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260806 15:56:35.389482 20435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33dca6dc67804a7c85debbf4a19e13e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:35.386813 20438 tablet_service.cc:1467] Processing CreateTablet for tablet 1cbc482a7e8441baa7b7977eb1000568 (DEFAULT_TABLE table=test-workload [id=4c5d249156234d82b8e8647252714fe4]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260806 15:56:35.389712 20438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cbc482a7e8441baa7b7977eb1000568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:35.386801 20436 tablet_service.cc:1467] Processing CreateTablet for tablet 74685e4f262148919770011323d2896d (DEFAULT_TABLE table=test-workload [id=4c5d249156234d82b8e8647252714fe4]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260806 15:56:35.387413 20432 tablet_service.cc:1467] Processing CreateTablet for tablet a63cd303a68347f48ac7a1d27c3f97dc (DEFAULT_TABLE table=test-workload [id=4c5d249156234d82b8e8647252714fe4]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260806 15:56:35.386732 20440 tablet_service.cc:1467] Processing CreateTablet for tablet cbed15382df9449dba570aeed2b4e120 (DEFAULT_TABLE table=test-workload [id=4c5d249156234d82b8e8647252714fe4]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260806 15:56:35.389896 20436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74685e4f262148919770011323d2896d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:35.390348 20440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbed15382df9449dba570aeed2b4e120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:35.387323 20437 tablet_service.cc:1467] Processing CreateTablet for tablet 5fee5bdb3cc44423a2b044e0aefc6b48 (DEFAULT_TABLE table=test-workload [id=4c5d249156234d82b8e8647252714fe4]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260806 15:56:35.390888 20437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fee5bdb3cc44423a2b044e0aefc6b48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:35.391258 20432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a63cd303a68347f48ac7a1d27c3f97dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:35.386732 20441 tablet_service.cc:1467] Processing CreateTablet for tablet 7f2cdb74b7ef455a988f41413b4485ad (DEFAULT_TABLE table=test-workload [id=4c5d249156234d82b8e8647252714fe4]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260806 15:56:35.386732 20434 tablet_service.cc:1467] Processing CreateTablet for tablet 972e4bfa29ea4b66814758e0fb3e38b4 (DEFAULT_TABLE table=test-workload [id=4c5d249156234d82b8e8647252714fe4]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260806 15:56:35.393484 20441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f2cdb74b7ef455a988f41413b4485ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:35.394366 20434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 972e4bfa29ea4b66814758e0fb3e38b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:35.396347 20524 tablet_bootstrap.cc:492] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c: Bootstrap starting.
I20260806 15:56:35.398919 20524 tablet_bootstrap.cc:654] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:35.400154 20524 log.cc:824] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:35.402307 20524 tablet_bootstrap.cc:492] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c: No bootstrap required, opened a new log
I20260806 15:56:35.402504 20524 ts_tablet_manager.cc:1397] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260806 15:56:35.405233 20524 raft_consensus.cc:348] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.405459 20524 raft_consensus.cc:729] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Initialized, Role: FOLLOWER
I20260806 15:56:35.405762 20524 consensus_queue.cc:260] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.406466 20509 heartbeater.cc:503] Master 127.10.189.254:35947 was elected leader, sending a full tablet report...
I20260806 15:56:35.406826 20524 ts_tablet_manager.cc:1428] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260806 15:56:35.407310 20524 tablet_bootstrap.cc:492] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c: Bootstrap starting.
I20260806 15:56:35.408360 20524 tablet_bootstrap.cc:654] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:35.409756 20524 tablet_bootstrap.cc:492] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c: No bootstrap required, opened a new log
I20260806 15:56:35.409874 20524 ts_tablet_manager.cc:1397] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 15:56:35.410576 20524 raft_consensus.cc:348] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.410691 20524 raft_consensus.cc:729] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Initialized, Role: FOLLOWER
I20260806 15:56:35.410804 20524 consensus_queue.cc:260] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.411084 20524 ts_tablet_manager.cc:1428] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:56:35.411214 20524 tablet_bootstrap.cc:492] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c: Bootstrap starting.
I20260806 15:56:35.412276 20524 tablet_bootstrap.cc:654] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:35.413753 20524 tablet_bootstrap.cc:492] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c: No bootstrap required, opened a new log
I20260806 15:56:35.413848 20524 ts_tablet_manager.cc:1397] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 15:56:35.414366 20524 raft_consensus.cc:348] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.414472 20524 raft_consensus.cc:729] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Initialized, Role: FOLLOWER
I20260806 15:56:35.414587 20524 consensus_queue.cc:260] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.414851 20524 ts_tablet_manager.cc:1428] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:56:35.415022 20524 tablet_bootstrap.cc:492] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c: Bootstrap starting.
I20260806 15:56:35.415792 20524 tablet_bootstrap.cc:654] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:35.417032 20524 tablet_bootstrap.cc:492] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c: No bootstrap required, opened a new log
I20260806 15:56:35.417128 20524 ts_tablet_manager.cc:1397] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:56:35.417498 20524 raft_consensus.cc:348] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.417614 20524 raft_consensus.cc:729] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Initialized, Role: FOLLOWER
I20260806 15:56:35.417718 20524 consensus_queue.cc:260] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.417984 20524 ts_tablet_manager.cc:1428] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 15:56:35.418184 20524 tablet_bootstrap.cc:492] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c: Bootstrap starting.
I20260806 15:56:35.419066 20524 tablet_bootstrap.cc:654] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:35.420173 20524 tablet_bootstrap.cc:492] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c: No bootstrap required, opened a new log
I20260806 15:56:35.420265 20524 ts_tablet_manager.cc:1397] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:56:35.420656 20524 raft_consensus.cc:348] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.420755 20524 raft_consensus.cc:729] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Initialized, Role: FOLLOWER
I20260806 15:56:35.420854 20524 consensus_queue.cc:260] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.421139 20524 ts_tablet_manager.cc:1428] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:56:35.421294 20524 tablet_bootstrap.cc:492] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c: Bootstrap starting.
I20260806 15:56:35.422184 20524 tablet_bootstrap.cc:654] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:35.423297 20524 tablet_bootstrap.cc:492] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c: No bootstrap required, opened a new log
I20260806 15:56:35.423380 20524 ts_tablet_manager.cc:1397] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260806 15:56:35.424196 20524 raft_consensus.cc:348] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.424299 20524 raft_consensus.cc:729] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Initialized, Role: FOLLOWER
I20260806 15:56:35.424392 20524 consensus_queue.cc:260] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.424640 20524 ts_tablet_manager.cc:1428] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 15:56:35.424793 20524 tablet_bootstrap.cc:492] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c: Bootstrap starting.
I20260806 15:56:35.425583 20524 tablet_bootstrap.cc:654] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:35.426661 20524 tablet_bootstrap.cc:492] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c: No bootstrap required, opened a new log
I20260806 15:56:35.426756 20524 ts_tablet_manager.cc:1397] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260806 15:56:35.427124 20524 raft_consensus.cc:348] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.427227 20524 raft_consensus.cc:729] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Initialized, Role: FOLLOWER
I20260806 15:56:35.427315 20524 consensus_queue.cc:260] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.427604 20524 ts_tablet_manager.cc:1428] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 15:56:35.427768 20524 tablet_bootstrap.cc:492] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c: Bootstrap starting.
I20260806 15:56:35.428704 20524 tablet_bootstrap.cc:654] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:35.429802 20524 tablet_bootstrap.cc:492] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c: No bootstrap required, opened a new log
I20260806 15:56:35.429881 20524 ts_tablet_manager.cc:1397] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260806 15:56:35.430311 20524 raft_consensus.cc:348] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.430388 20524 raft_consensus.cc:729] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Initialized, Role: FOLLOWER
I20260806 15:56:35.430481 20524 consensus_queue.cc:260] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.430739 20524 ts_tablet_manager.cc:1428] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:56:35.430912 20524 tablet_bootstrap.cc:492] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c: Bootstrap starting.
I20260806 15:56:35.431782 20524 tablet_bootstrap.cc:654] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:35.432940 20524 tablet_bootstrap.cc:492] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c: No bootstrap required, opened a new log
I20260806 15:56:35.433034 20524 ts_tablet_manager.cc:1397] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:56:35.433740 20524 raft_consensus.cc:348] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.433853 20524 raft_consensus.cc:729] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Initialized, Role: FOLLOWER
I20260806 15:56:35.433933 20524 consensus_queue.cc:260] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.434244 20524 ts_tablet_manager.cc:1428] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:56:35.434446 20524 tablet_bootstrap.cc:492] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c: Bootstrap starting.
I20260806 15:56:35.435379 20524 tablet_bootstrap.cc:654] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:35.436412 20524 tablet_bootstrap.cc:492] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c: No bootstrap required, opened a new log
I20260806 15:56:35.436507 20524 ts_tablet_manager.cc:1397] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:56:35.436954 20524 raft_consensus.cc:348] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.437057 20524 raft_consensus.cc:729] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Initialized, Role: FOLLOWER
I20260806 15:56:35.437143 20524 consensus_queue.cc:260] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.437390 20524 ts_tablet_manager.cc:1428] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 15:56:35.472249 20461 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "cbed15382df9449dba570aeed2b4e120"
dest_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c"
from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.472481 20461 raft_consensus.cc:482] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:35.472580 20461 raft_consensus.cc:3037] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:35.473567 20461 raft_consensus.cc:504] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.473912 20461 leader_election.cc:302] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5df3e5f5af148bc9f8cb1c28c8a063c; no voters:
I20260806 15:56:35.474189 20461 leader_election.cc:288] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:56:35.474275 20526 raft_consensus.cc:2781] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:35.474581 20526 raft_consensus.cc:686] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Becoming Leader. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Running, Role: LEADER
I20260806 15:56:35.474927 20526 consensus_queue.cc:237] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.477897 20310 catalog_manager.cc:5495] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c reported cstate change: term changed from 0 to 1, leader changed from <none> to f5df3e5f5af148bc9f8cb1c28c8a063c (127.10.189.193). New cstate: current_term: 1 leader_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } health_report { overall_health: HEALTHY } } }
I20260806 15:56:35.484061 20461 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5fee5bdb3cc44423a2b044e0aefc6b48"
dest_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c"
from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.484254 20461 raft_consensus.cc:482] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:35.484333 20461 raft_consensus.cc:3037] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:35.485217 20461 raft_consensus.cc:504] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.485383 20461 leader_election.cc:302] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5df3e5f5af148bc9f8cb1c28c8a063c; no voters:
I20260806 15:56:35.485496 20461 leader_election.cc:288] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:56:35.485538 20526 raft_consensus.cc:2781] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:35.485610 20526 raft_consensus.cc:686] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Becoming Leader. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Running, Role: LEADER
I20260806 15:56:35.485746 20526 consensus_queue.cc:237] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.487336 20310 catalog_manager.cc:5495] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c reported cstate change: term changed from 0 to 1, leader changed from <none> to f5df3e5f5af148bc9f8cb1c28c8a063c (127.10.189.193). New cstate: current_term: 1 leader_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } health_report { overall_health: HEALTHY } } }
I20260806 15:56:35.492578 20461 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c371444095fb4b72b193f87e21cb019d"
dest_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c"
from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.492707 20461 raft_consensus.cc:482] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:35.492794 20461 raft_consensus.cc:3037] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:35.493649 20461 raft_consensus.cc:504] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.493768 20461 leader_election.cc:302] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5df3e5f5af148bc9f8cb1c28c8a063c; no voters:
I20260806 15:56:35.493892 20461 leader_election.cc:288] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:56:35.493985 20526 raft_consensus.cc:2781] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:35.494130 20526 raft_consensus.cc:686] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Becoming Leader. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Running, Role: LEADER
I20260806 15:56:35.494272 20526 consensus_queue.cc:237] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.496230 20310 catalog_manager.cc:5495] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c reported cstate change: term changed from 0 to 1, leader changed from <none> to f5df3e5f5af148bc9f8cb1c28c8a063c (127.10.189.193). New cstate: current_term: 1 leader_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } health_report { overall_health: HEALTHY } } }
I20260806 15:56:35.501411 20461 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1cbc482a7e8441baa7b7977eb1000568"
dest_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c"
from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.501531 20461 raft_consensus.cc:482] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:35.501603 20461 raft_consensus.cc:3037] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:35.502548 20461 raft_consensus.cc:504] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.502686 20461 leader_election.cc:302] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5df3e5f5af148bc9f8cb1c28c8a063c; no voters:
I20260806 15:56:35.502784 20461 leader_election.cc:288] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:56:35.502827 20526 raft_consensus.cc:2781] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:35.502977 20526 raft_consensus.cc:686] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Becoming Leader. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Running, Role: LEADER
I20260806 15:56:35.503113 20526 consensus_queue.cc:237] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.504869 20310 catalog_manager.cc:5495] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c reported cstate change: term changed from 0 to 1, leader changed from <none> to f5df3e5f5af148bc9f8cb1c28c8a063c (127.10.189.193). New cstate: current_term: 1 leader_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } health_report { overall_health: HEALTHY } } }
I20260806 15:56:35.509765 20461 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "74685e4f262148919770011323d2896d"
dest_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c"
from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.509918 20461 raft_consensus.cc:482] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:35.509989 20461 raft_consensus.cc:3037] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:35.510851 20461 raft_consensus.cc:504] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.510998 20461 leader_election.cc:302] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5df3e5f5af148bc9f8cb1c28c8a063c; no voters:
I20260806 15:56:35.511111 20461 leader_election.cc:288] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:56:35.511207 20526 raft_consensus.cc:2781] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:35.511329 20526 raft_consensus.cc:686] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Becoming Leader. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Running, Role: LEADER
I20260806 15:56:35.511487 20526 consensus_queue.cc:237] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.513363 20310 catalog_manager.cc:5495] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c reported cstate change: term changed from 0 to 1, leader changed from <none> to f5df3e5f5af148bc9f8cb1c28c8a063c (127.10.189.193). New cstate: current_term: 1 leader_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } health_report { overall_health: HEALTHY } } }
I20260806 15:56:35.517926 20461 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "33dca6dc67804a7c85debbf4a19e13e6"
dest_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c"
from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.518045 20461 raft_consensus.cc:482] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:35.518146 20461 raft_consensus.cc:3037] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:35.518929 20461 raft_consensus.cc:504] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.519052 20461 leader_election.cc:302] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5df3e5f5af148bc9f8cb1c28c8a063c; no voters:
I20260806 15:56:35.519145 20461 leader_election.cc:288] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:56:35.519212 20538 raft_consensus.cc:2781] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:35.519301 20538 raft_consensus.cc:686] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Becoming Leader. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Running, Role: LEADER
I20260806 15:56:35.519424 20538 consensus_queue.cc:237] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.520843 20310 catalog_manager.cc:5495] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c reported cstate change: term changed from 0 to 1, leader changed from <none> to f5df3e5f5af148bc9f8cb1c28c8a063c (127.10.189.193). New cstate: current_term: 1 leader_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } health_report { overall_health: HEALTHY } } }
I20260806 15:56:35.526243 20461 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a63cd303a68347f48ac7a1d27c3f97dc"
dest_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c"
from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.526386 20461 raft_consensus.cc:482] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:35.526453 20461 raft_consensus.cc:3037] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:35.527362 20461 raft_consensus.cc:504] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.527515 20461 leader_election.cc:302] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5df3e5f5af148bc9f8cb1c28c8a063c; no voters:
I20260806 15:56:35.527632 20461 leader_election.cc:288] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:56:35.527673 20538 raft_consensus.cc:2781] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:35.527772 20538 raft_consensus.cc:686] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Becoming Leader. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Running, Role: LEADER
I20260806 15:56:35.527904 20538 consensus_queue.cc:237] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.529512 20310 catalog_manager.cc:5495] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c reported cstate change: term changed from 0 to 1, leader changed from <none> to f5df3e5f5af148bc9f8cb1c28c8a063c (127.10.189.193). New cstate: current_term: 1 leader_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } health_report { overall_health: HEALTHY } } }
I20260806 15:56:35.534546 20461 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7f2cdb74b7ef455a988f41413b4485ad"
dest_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c"
from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.534672 20461 raft_consensus.cc:482] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:35.534736 20461 raft_consensus.cc:3037] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:35.535492 20461 raft_consensus.cc:504] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.535627 20461 leader_election.cc:302] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5df3e5f5af148bc9f8cb1c28c8a063c; no voters:
I20260806 15:56:35.535733 20461 leader_election.cc:288] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:56:35.535808 20526 raft_consensus.cc:2781] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:35.535918 20526 raft_consensus.cc:686] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Becoming Leader. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Running, Role: LEADER
I20260806 15:56:35.536044 20526 consensus_queue.cc:237] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.537456 20310 catalog_manager.cc:5495] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c reported cstate change: term changed from 0 to 1, leader changed from <none> to f5df3e5f5af148bc9f8cb1c28c8a063c (127.10.189.193). New cstate: current_term: 1 leader_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } health_report { overall_health: HEALTHY } } }
I20260806 15:56:35.542577 20461 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "972e4bfa29ea4b66814758e0fb3e38b4"
dest_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c"
from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.542716 20461 raft_consensus.cc:482] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:35.542788 20461 raft_consensus.cc:3037] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:35.543537 20461 raft_consensus.cc:504] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.543679 20461 leader_election.cc:302] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5df3e5f5af148bc9f8cb1c28c8a063c; no voters:
I20260806 15:56:35.543789 20461 leader_election.cc:288] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:56:35.543828 20538 raft_consensus.cc:2781] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:35.543907 20538 raft_consensus.cc:686] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Becoming Leader. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Running, Role: LEADER
I20260806 15:56:35.544060 20538 consensus_queue.cc:237] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.545532 20310 catalog_manager.cc:5495] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c reported cstate change: term changed from 0 to 1, leader changed from <none> to f5df3e5f5af148bc9f8cb1c28c8a063c (127.10.189.193). New cstate: current_term: 1 leader_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } health_report { overall_health: HEALTHY } } }
I20260806 15:56:35.550602 20461 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "473f12b24ec2473f95c293d29682c9bc"
dest_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c"
from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.550734 20461 raft_consensus.cc:482] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:35.550799 20461 raft_consensus.cc:3037] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:35.551618 20461 raft_consensus.cc:504] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.551750 20461 leader_election.cc:302] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5df3e5f5af148bc9f8cb1c28c8a063c; no voters:
I20260806 15:56:35.551865 20461 leader_election.cc:288] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:56:35.551941 20538 raft_consensus.cc:2781] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:35.552066 20538 raft_consensus.cc:686] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Becoming Leader. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Running, Role: LEADER
I20260806 15:56:35.552201 20538 consensus_queue.cc:237] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.553612 20310 catalog_manager.cc:5495] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c reported cstate change: term changed from 0 to 1, leader changed from <none> to f5df3e5f5af148bc9f8cb1c28c8a063c (127.10.189.193). New cstate: current_term: 1 leader_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } health_report { overall_health: HEALTHY } } }
I20260806 15:56:35.558837 20440 tablet_service.cc:1514] Processing DeleteTablet for tablet cbed15382df9449dba570aeed2b4e120 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.559290 20551 tablet_replica.cc:330] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c: stopping tablet replica
I20260806 15:56:35.559645 20551 raft_consensus.cc:2229] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:56:35.559866 20551 raft_consensus.cc:2258] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:56:35.561133 20551 ts_tablet_manager.cc:1905] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260806 15:56:35.563197 20551 ts_tablet_manager.cc:1918] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260806 15:56:35.563304 20551 log.cc:1196] T cbed15382df9449dba570aeed2b4e120 P f5df3e5f5af148bc9f8cb1c28c8a063c: Deleting WAL directory at /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/wals/cbed15382df9449dba570aeed2b4e120
I20260806 15:56:35.569461 20440 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fee5bdb3cc44423a2b044e0aefc6b48 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.569679 20551 tablet_replica.cc:330] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c: stopping tablet replica
I20260806 15:56:35.569839 20551 raft_consensus.cc:2229] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:56:35.569972 20551 raft_consensus.cc:2258] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:56:35.570647 20551 ts_tablet_manager.cc:1905] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260806 15:56:35.572412 20551 ts_tablet_manager.cc:1918] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260806 15:56:35.572513 20551 log.cc:1196] T 5fee5bdb3cc44423a2b044e0aefc6b48 P f5df3e5f5af148bc9f8cb1c28c8a063c: Deleting WAL directory at /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/wals/5fee5bdb3cc44423a2b044e0aefc6b48
I20260806 15:56:35.578577 20440 tablet_service.cc:1514] Processing DeleteTablet for tablet c371444095fb4b72b193f87e21cb019d with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.578756 20551 tablet_replica.cc:330] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c: stopping tablet replica
I20260806 15:56:35.579165 20551 raft_consensus.cc:2229] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:56:35.579283 20551 raft_consensus.cc:2258] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:56:35.579838 20551 ts_tablet_manager.cc:1905] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260806 15:56:35.581718 20551 ts_tablet_manager.cc:1918] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260806 15:56:35.581781 20551 log.cc:1196] T c371444095fb4b72b193f87e21cb019d P f5df3e5f5af148bc9f8cb1c28c8a063c: Deleting WAL directory at /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/wals/c371444095fb4b72b193f87e21cb019d
I20260806 15:56:35.587604 20440 tablet_service.cc:1514] Processing DeleteTablet for tablet 1cbc482a7e8441baa7b7977eb1000568 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.587770 20551 tablet_replica.cc:330] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c: stopping tablet replica
I20260806 15:56:35.587867 20551 raft_consensus.cc:2229] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:56:35.587965 20551 raft_consensus.cc:2258] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:56:35.588498 20551 ts_tablet_manager.cc:1905] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260806 15:56:35.590030 20551 ts_tablet_manager.cc:1918] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260806 15:56:35.590150 20551 log.cc:1196] T 1cbc482a7e8441baa7b7977eb1000568 P f5df3e5f5af148bc9f8cb1c28c8a063c: Deleting WAL directory at /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/wals/1cbc482a7e8441baa7b7977eb1000568
I20260806 15:56:35.596109 20440 tablet_service.cc:1514] Processing DeleteTablet for tablet 74685e4f262148919770011323d2896d with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.596308 20551 tablet_replica.cc:330] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c: stopping tablet replica
I20260806 15:56:35.596410 20551 raft_consensus.cc:2229] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:56:35.596525 20551 raft_consensus.cc:2258] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:56:35.597157 20551 ts_tablet_manager.cc:1905] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260806 15:56:35.598837 20551 ts_tablet_manager.cc:1918] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260806 15:56:35.598904 20551 log.cc:1196] T 74685e4f262148919770011323d2896d P f5df3e5f5af148bc9f8cb1c28c8a063c: Deleting WAL directory at /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/wals/74685e4f262148919770011323d2896d
I20260806 15:56:35.605046 20461 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "33dca6dc67804a7c85debbf4a19e13e6"
dest_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c"
from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.605243 20461 raft_consensus.cc:580] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Received request to step down
I20260806 15:56:35.605300 20461 raft_consensus.cc:3032] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Stepping down as leader of term 1
I20260806 15:56:35.605347 20461 raft_consensus.cc:729] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Running, Role: LEADER
I20260806 15:56:35.605497 20461 consensus_queue.cc:260] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.605576 20461 raft_consensus.cc:3037] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:35.611428 20440 tablet_service.cc:1514] Processing DeleteTablet for tablet 33dca6dc67804a7c85debbf4a19e13e6 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.611670 20551 tablet_replica.cc:330] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c: stopping tablet replica
I20260806 15:56:35.611797 20551 raft_consensus.cc:2229] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260806 15:56:35.611912 20551 raft_consensus.cc:2258] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260806 15:56:35.612618 20551 ts_tablet_manager.cc:1905] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260806 15:56:35.614521 20551 ts_tablet_manager.cc:1918] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260806 15:56:35.614591 20551 log.cc:1196] T 33dca6dc67804a7c85debbf4a19e13e6 P f5df3e5f5af148bc9f8cb1c28c8a063c: Deleting WAL directory at /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/wals/33dca6dc67804a7c85debbf4a19e13e6
I20260806 15:56:35.620539 20461 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a63cd303a68347f48ac7a1d27c3f97dc"
dest_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c"
from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.620725 20461 raft_consensus.cc:580] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Received request to step down
I20260806 15:56:35.620790 20461 raft_consensus.cc:3032] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Stepping down as leader of term 1
I20260806 15:56:35.620844 20461 raft_consensus.cc:729] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Running, Role: LEADER
I20260806 15:56:35.620983 20461 consensus_queue.cc:260] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.621066 20461 raft_consensus.cc:3037] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:35.626989 20440 tablet_service.cc:1514] Processing DeleteTablet for tablet a63cd303a68347f48ac7a1d27c3f97dc with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.627209 20551 tablet_replica.cc:330] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c: stopping tablet replica
I20260806 15:56:35.627357 20551 raft_consensus.cc:2229] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260806 15:56:35.627488 20551 raft_consensus.cc:2258] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260806 15:56:35.628141 20551 ts_tablet_manager.cc:1905] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260806 15:56:35.629925 20551 ts_tablet_manager.cc:1918] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260806 15:56:35.630002 20551 log.cc:1196] T a63cd303a68347f48ac7a1d27c3f97dc P f5df3e5f5af148bc9f8cb1c28c8a063c: Deleting WAL directory at /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/wals/a63cd303a68347f48ac7a1d27c3f97dc
I20260806 15:56:35.636214 20461 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7f2cdb74b7ef455a988f41413b4485ad"
dest_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c"
from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.636394 20461 raft_consensus.cc:580] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Received request to step down
I20260806 15:56:35.636468 20461 raft_consensus.cc:3032] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Stepping down as leader of term 1
I20260806 15:56:35.636510 20461 raft_consensus.cc:729] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Running, Role: LEADER
I20260806 15:56:35.636642 20461 consensus_queue.cc:260] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.636734 20461 raft_consensus.cc:3037] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:35.642668 20440 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f2cdb74b7ef455a988f41413b4485ad with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.642920 20551 tablet_replica.cc:330] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c: stopping tablet replica
I20260806 15:56:35.643043 20551 raft_consensus.cc:2229] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260806 15:56:35.643204 20551 raft_consensus.cc:2258] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260806 15:56:35.643890 20551 ts_tablet_manager.cc:1905] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260806 15:56:35.645924 20551 ts_tablet_manager.cc:1918] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260806 15:56:35.646011 20551 log.cc:1196] T 7f2cdb74b7ef455a988f41413b4485ad P f5df3e5f5af148bc9f8cb1c28c8a063c: Deleting WAL directory at /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/wals/7f2cdb74b7ef455a988f41413b4485ad
I20260806 15:56:35.652419 20461 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "972e4bfa29ea4b66814758e0fb3e38b4"
dest_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c"
from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.652623 20461 raft_consensus.cc:580] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Received request to step down
I20260806 15:56:35.652693 20461 raft_consensus.cc:3032] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Stepping down as leader of term 1
I20260806 15:56:35.652761 20461 raft_consensus.cc:729] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Running, Role: LEADER
I20260806 15:56:35.652892 20461 consensus_queue.cc:260] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.653024 20461 raft_consensus.cc:3037] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:35.659086 20440 tablet_service.cc:1514] Processing DeleteTablet for tablet 972e4bfa29ea4b66814758e0fb3e38b4 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.659469 20551 tablet_replica.cc:330] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c: stopping tablet replica
I20260806 15:56:35.659641 20551 raft_consensus.cc:2229] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260806 15:56:35.659795 20551 raft_consensus.cc:2258] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260806 15:56:35.660555 20551 ts_tablet_manager.cc:1905] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260806 15:56:35.662675 20551 ts_tablet_manager.cc:1918] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260806 15:56:35.662745 20551 log.cc:1196] T 972e4bfa29ea4b66814758e0fb3e38b4 P f5df3e5f5af148bc9f8cb1c28c8a063c: Deleting WAL directory at /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/wals/972e4bfa29ea4b66814758e0fb3e38b4
I20260806 15:56:35.669260 20461 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "473f12b24ec2473f95c293d29682c9bc"
dest_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c"
from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.669461 20461 raft_consensus.cc:580] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Received request to step down
I20260806 15:56:35.669528 20461 raft_consensus.cc:3032] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Stepping down as leader of term 1
I20260806 15:56:35.669580 20461 raft_consensus.cc:729] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5df3e5f5af148bc9f8cb1c28c8a063c, State: Running, Role: LEADER
I20260806 15:56:35.669711 20461 consensus_queue.cc:260] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5df3e5f5af148bc9f8cb1c28c8a063c" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 45221 } }
I20260806 15:56:35.669802 20461 raft_consensus.cc:3037] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:35.675540 20440 tablet_service.cc:1514] Processing DeleteTablet for tablet 473f12b24ec2473f95c293d29682c9bc with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:57908
I20260806 15:56:35.675807 20551 tablet_replica.cc:330] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c: stopping tablet replica
I20260806 15:56:35.675948 20551 raft_consensus.cc:2229] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260806 15:56:35.676097 20551 raft_consensus.cc:2258] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260806 15:56:35.676802 20551 ts_tablet_manager.cc:1905] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260806 15:56:35.678954 20551 ts_tablet_manager.cc:1918] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260806 15:56:35.679029 20551 log.cc:1196] T 473f12b24ec2473f95c293d29682c9bc P f5df3e5f5af148bc9f8cb1c28c8a063c: Deleting WAL directory at /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/wals/473f12b24ec2473f95c293d29682c9bc
I20260806 15:56:35.685881 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 20375
I20260806 15:56:35.693535 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 20280
2026-08-06T15:56:35Z chronyd exiting
[ OK ] NumReplicas/RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric/0 (820 ms)
[ RUN ] NumReplicas/RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric/1
I20260806 15:56:35.717046 10999 test_util.cc:268] Using random seed: -289553489
I20260806 15:56:35.718034 10999 ts_itest-base.cc:112] Starting cluster with:
I20260806 15:56:35.718314 10999 ts_itest-base.cc:113] --------------
I20260806 15:56:35.718353 10999 ts_itest-base.cc:114] 3 tablet servers
I20260806 15:56:35.718375 10999 ts_itest-base.cc:115] 3 replicas per TS
I20260806 15:56:35.718395 10999 ts_itest-base.cc:116] --------------
2026-08-06T15:56:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:56:35Z Disabled control of system clock
I20260806 15:56:35.730674 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:33127
--webserver_interface=127.10.189.254
--webserver_port=0
--builtin_ntp_servers=127.10.189.212:36585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.189.254:33127
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260806 15:56:35.856940 20559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:35.857236 20559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:35.857271 20559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:35.861424 20559 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:56:35.861490 20559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:35.861508 20559 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:56:35.861524 20559 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:56:35.866286 20559 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:36585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.10.189.254:33127
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.189.254:33127
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.10.189.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.20559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:35.867429 20559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:35.868774 20559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:35.877144 20568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:35.877302 20559 server_base.cc:1034] running on GCE node
W20260806 15:56:35.877164 20565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:35.877501 20566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:35.878053 20559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:35.879252 20559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:35.880450 20559 hybrid_clock.cc:648] HybridClock initialized: now 1786031795880433 us; error 32 us; skew 500 ppm
I20260806 15:56:35.882702 20559 webserver.cc:460] Webserver started at http://127.10.189.254:46007/ using document root <none> and password file <none>
I20260806 15:56:35.883323 20559 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:35.883399 20559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:35.883592 20559 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:35.885736 20559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "574c92e10a344dec8e5047ecf0c68166"
format_stamp: "Formatted at 2026-08-06 15:56:35 on dist-test-slave-mn4r"
I20260806 15:56:35.886382 20559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "574c92e10a344dec8e5047ecf0c68166"
format_stamp: "Formatted at 2026-08-06 15:56:35 on dist-test-slave-mn4r"
I20260806 15:56:35.890429 20559 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 15:56:35.892900 20574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:35.894327 20559 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 15:56:35.894429 20559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
uuid: "574c92e10a344dec8e5047ecf0c68166"
format_stamp: "Formatted at 2026-08-06 15:56:35 on dist-test-slave-mn4r"
I20260806 15:56:35.894515 20559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:35.916392 20559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:35.917090 20559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:35.917253 20559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:35.924626 20559 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.254:33127
I20260806 15:56:35.924654 20628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.254:33127 every 8 connection(s)
I20260806 15:56:35.925668 20559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260806 15:56:35.927886 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 20559
I20260806 15:56:35.928025 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260806 15:56:35.929193 20629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:35.935655 20629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166: Bootstrap starting.
I20260806 15:56:35.938236 20629 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:35.938979 20629 log.cc:824] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:35.940791 20629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166: No bootstrap required, opened a new log
I20260806 15:56:35.944301 20629 raft_consensus.cc:348] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "574c92e10a344dec8e5047ecf0c68166" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 33127 } }
I20260806 15:56:35.944553 20629 raft_consensus.cc:374] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:56:35.944625 20629 raft_consensus.cc:729] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 574c92e10a344dec8e5047ecf0c68166, State: Initialized, Role: FOLLOWER
I20260806 15:56:35.945061 20629 consensus_queue.cc:260] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "574c92e10a344dec8e5047ecf0c68166" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 33127 } }
I20260806 15:56:35.945218 20629 raft_consensus.cc:388] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:56:35.945284 20629 raft_consensus.cc:482] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:56:35.945395 20629 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:35.946324 20629 raft_consensus.cc:504] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "574c92e10a344dec8e5047ecf0c68166" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 33127 } }
I20260806 15:56:35.946659 20629 leader_election.cc:302] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 574c92e10a344dec8e5047ecf0c68166; no voters:
I20260806 15:56:35.946967 20629 leader_election.cc:288] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:56:35.947150 20634 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:35.947391 20634 raft_consensus.cc:686] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166 [term 1 LEADER]: Becoming Leader. State: Replica: 574c92e10a344dec8e5047ecf0c68166, State: Running, Role: LEADER
I20260806 15:56:35.947691 20634 consensus_queue.cc:237] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "574c92e10a344dec8e5047ecf0c68166" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 33127 } }
I20260806 15:56:35.948171 20629 sys_catalog.cc:564] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:56:35.949324 20636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 574c92e10a344dec8e5047ecf0c68166. Latest consensus state: current_term: 1 leader_uuid: "574c92e10a344dec8e5047ecf0c68166" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "574c92e10a344dec8e5047ecf0c68166" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 33127 } } }
I20260806 15:56:35.949465 20636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166 [sys.catalog]: This master's current role is: LEADER
I20260806 15:56:35.949693 20635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "574c92e10a344dec8e5047ecf0c68166" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "574c92e10a344dec8e5047ecf0c68166" member_type: VOTER last_known_addr { host: "127.10.189.254" port: 33127 } } }
I20260806 15:56:35.949849 20635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166 [sys.catalog]: This master's current role is: LEADER
I20260806 15:56:35.949864 20644 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:56:35.953204 20644 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:56:35.958771 20644 catalog_manager.cc:1347] Generated new cluster ID: cf3e7e48faa14f678ef475cdf182c673
I20260806 15:56:35.958846 20644 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:56:35.971900 20644 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:56:35.972808 20644 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:56:35.980159 20644 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 574c92e10a344dec8e5047ecf0c68166: Generated new TSK 0
I20260806 15:56:35.980821 20644 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:56:35.985743 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.193:0
--local_ip_for_outbound_sockets=127.10.189.193
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:33127
--builtin_ntp_servers=127.10.189.212:36585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260806 15:56:36.113226 20654 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:56:36.113515 20654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:36.113538 20654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:36.113570 20654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:36.118427 20654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:36.118535 20654 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.193
I20260806 15:56:36.123425 20654 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:36585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.10.189.193
--webserver_port=0
--tserver_master_addrs=127.10.189.254:33127
--never_fsync=true
--heap_profile_path=/tmp/kudu.20654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.193
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:36.124512 20654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:36.126000 20654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:36.135794 20663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:36.135788 20660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:36.135783 20661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:36.136058 20654 server_base.cc:1034] running on GCE node
I20260806 15:56:36.136471 20654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:36.137161 20654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:36.138342 20654 hybrid_clock.cc:648] HybridClock initialized: now 1786031796138320 us; error 32 us; skew 500 ppm
I20260806 15:56:36.140175 20654 webserver.cc:460] Webserver started at http://127.10.189.193:44043/ using document root <none> and password file <none>
I20260806 15:56:36.140764 20654 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:36.140853 20654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:36.141112 20654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:36.143095 20654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "c6e9c56ffbd74798bcd294b8bed04c7b"
format_stamp: "Formatted at 2026-08-06 15:56:36 on dist-test-slave-mn4r"
I20260806 15:56:36.143635 20654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "c6e9c56ffbd74798bcd294b8bed04c7b"
format_stamp: "Formatted at 2026-08-06 15:56:36 on dist-test-slave-mn4r"
I20260806 15:56:36.147255 20654 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 15:56:36.149760 20669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:36.151124 20654 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 15:56:36.151259 20654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "c6e9c56ffbd74798bcd294b8bed04c7b"
format_stamp: "Formatted at 2026-08-06 15:56:36 on dist-test-slave-mn4r"
I20260806 15:56:36.151365 20654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:36.168099 20654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:36.168799 20654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:36.169034 20654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:36.169696 20654 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:36.170678 20654 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:36.170725 20654 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:36.170768 20654 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:36.170791 20654 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:36.179656 20654 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.193:36689
I20260806 15:56:36.179682 20783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.193:36689 every 8 connection(s)
I20260806 15:56:36.180572 20654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260806 15:56:36.183292 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 20654
I20260806 15:56:36.183427 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260806 15:56:36.185714 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.194:0
--local_ip_for_outbound_sockets=127.10.189.194
--webserver_interface=127.10.189.194
--webserver_port=0
--tserver_master_addrs=127.10.189.254:33127
--builtin_ntp_servers=127.10.189.212:36585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260806 15:56:36.192008 20784 heartbeater.cc:347] Connected to a master server at 127.10.189.254:33127
I20260806 15:56:36.192278 20784 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:36.192948 20784 heartbeater.cc:511] Master 127.10.189.254:33127 requested a full tablet report, sending...
I20260806 15:56:36.194619 20592 ts_manager.cc:194] Registered new tserver with Master: c6e9c56ffbd74798bcd294b8bed04c7b (127.10.189.193:36689)
I20260806 15:56:36.195752 20592 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.193:46669
W20260806 15:56:36.298180 20787 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:56:36.298482 20787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:36.298543 20787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:36.298607 20787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:36.302613 20787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:36.302750 20787 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.194
I20260806 15:56:36.307317 20787 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:36585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.10.189.194
--webserver_port=0
--tserver_master_addrs=127.10.189.254:33127
--never_fsync=true
--heap_profile_path=/tmp/kudu.20787
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.194
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:36.308358 20787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:36.309723 20787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:36.319034 20795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:36.319082 20792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:36.319088 20793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:36.319268 20787 server_base.cc:1034] running on GCE node
I20260806 15:56:36.319846 20787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:36.320398 20787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:36.321547 20787 hybrid_clock.cc:648] HybridClock initialized: now 1786031796321519 us; error 42 us; skew 500 ppm
I20260806 15:56:36.323464 20787 webserver.cc:460] Webserver started at http://127.10.189.194:35257/ using document root <none> and password file <none>
I20260806 15:56:36.323985 20787 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:36.324043 20787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:36.324203 20787 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:36.326128 20787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "559a99d65dfa41c7a118f5f7b5378b15"
format_stamp: "Formatted at 2026-08-06 15:56:36 on dist-test-slave-mn4r"
I20260806 15:56:36.326655 20787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "559a99d65dfa41c7a118f5f7b5378b15"
format_stamp: "Formatted at 2026-08-06 15:56:36 on dist-test-slave-mn4r"
I20260806 15:56:36.330168 20787 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260806 15:56:36.332474 20801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:36.333626 20787 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 15:56:36.333763 20787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "559a99d65dfa41c7a118f5f7b5378b15"
format_stamp: "Formatted at 2026-08-06 15:56:36 on dist-test-slave-mn4r"
I20260806 15:56:36.333866 20787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:36.351713 20787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:36.352319 20787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:36.352507 20787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:36.353049 20787 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:36.353976 20787 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:36.354041 20787 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:36.354123 20787 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:36.354175 20787 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:36.362725 20787 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.194:35147
I20260806 15:56:36.362764 20918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.194:35147 every 8 connection(s)
I20260806 15:56:36.363600 20787 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260806 15:56:36.372905 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 20787
I20260806 15:56:36.373054 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260806 15:56:36.374620 20919 heartbeater.cc:347] Connected to a master server at 127.10.189.254:33127
I20260806 15:56:36.374923 20919 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:36.375483 20919 heartbeater.cc:511] Master 127.10.189.254:33127 requested a full tablet report, sending...
I20260806 15:56:36.375660 10999 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
/tmp/dist-test-taskSIF0T4/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.189.195:0
--local_ip_for_outbound_sockets=127.10.189.195
--webserver_interface=127.10.189.195
--webserver_port=0
--tserver_master_addrs=127.10.189.254:33127
--builtin_ntp_servers=127.10.189.212:36585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260806 15:56:36.376645 20591 ts_manager.cc:194] Registered new tserver with Master: 559a99d65dfa41c7a118f5f7b5378b15 (127.10.189.194:35147)
I20260806 15:56:36.377244 20591 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.194:58449
W20260806 15:56:36.486562 20922 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:56:36.486825 20922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:56:36.486845 20922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:56:36.486907 20922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:56:36.490870 20922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:56:36.490972 20922 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.189.195
I20260806 15:56:36.495679 20922 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.189.212:36585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.189.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.189.195
--webserver_port=0
--tserver_master_addrs=127.10.189.254:33127
--never_fsync=true
--heap_profile_path=/tmp/kudu.20922
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.189.195
--log_dir=/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 15:06:40 UTC on ccycloud.quasar-amrkwm.root.comops.site
build id 4570627
I20260806 15:56:36.496781 20922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:56:36.498246 20922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:56:36.508051 20927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:56:36.508092 20930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:36.508100 20922 server_base.cc:1034] running on GCE node
W20260806 15:56:36.508040 20928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:56:36.508651 20922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:56:36.509284 20922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:56:36.510457 20922 hybrid_clock.cc:648] HybridClock initialized: now 1786031796510444 us; error 23 us; skew 500 ppm
I20260806 15:56:36.512337 20922 webserver.cc:460] Webserver started at http://127.10.189.195:38737/ using document root <none> and password file <none>
I20260806 15:56:36.512905 20922 fs_manager.cc:359] Metadata directory not provided
I20260806 15:56:36.513020 20922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:56:36.513258 20922 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:56:36.515295 20922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "c8e4566a076444e3af4c37efe616fb03"
format_stamp: "Formatted at 2026-08-06 15:56:36 on dist-test-slave-mn4r"
I20260806 15:56:36.515926 20922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "c8e4566a076444e3af4c37efe616fb03"
format_stamp: "Formatted at 2026-08-06 15:56:36 on dist-test-slave-mn4r"
I20260806 15:56:36.519830 20922 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260806 15:56:36.522219 20936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:36.523449 20922 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 15:56:36.523576 20922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "c8e4566a076444e3af4c37efe616fb03"
format_stamp: "Formatted at 2026-08-06 15:56:36 on dist-test-slave-mn4r"
I20260806 15:56:36.523699 20922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:56:36.556756 20922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:56:36.557520 20922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:56:36.557715 20922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:56:36.558354 20922 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:56:36.559305 20922 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:56:36.559352 20922 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:36.559419 20922 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:56:36.559453 20922 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:56:36.568441 20922 rpc_server.cc:307] RPC server started. Bound to: 127.10.189.195:36829
I20260806 15:56:36.568477 21053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.189.195:36829 every 8 connection(s)
I20260806 15:56:36.569367 20922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260806 15:56:36.572655 10999 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu as pid 20922
I20260806 15:56:36.572788 10999 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260806 15:56:36.579684 21054 heartbeater.cc:347] Connected to a master server at 127.10.189.254:33127
I20260806 15:56:36.579927 21054 heartbeater.cc:464] Registering TS with master...
I20260806 15:56:36.580436 21054 heartbeater.cc:511] Master 127.10.189.254:33127 requested a full tablet report, sending...
I20260806 15:56:36.581404 20591 ts_manager.cc:194] Registered new tserver with Master: c8e4566a076444e3af4c37efe616fb03 (127.10.189.195:36829)
I20260806 15:56:36.581938 20591 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.189.195:48375
I20260806 15:56:36.586710 10999 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:56:36.595633 10999 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:56:36.595682 10999 test_util.cc:268] Using random seed: -288674845
I20260806 15:56:36.605576 20591 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33868:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:56:36.607121 20591 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:56:36.629666 20851 tablet_service.cc:1467] Processing CreateTablet for tablet ad396afd73ed44c99daa347b0eb0a792 (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260806 15:56:36.630640 20842 tablet_service.cc:1467] Processing CreateTablet for tablet 1476e13140e04607b41f18bfe2f9c9a0 (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260806 15:56:36.630028 20985 tablet_service.cc:1467] Processing CreateTablet for tablet ad396afd73ed44c99daa347b0eb0a792 (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260806 15:56:36.630265 20709 tablet_service.cc:1467] Processing CreateTablet for tablet 67b1065bf6494d17931f0c1cd042c5e3 (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260806 15:56:36.630972 20977 tablet_service.cc:1467] Processing CreateTablet for tablet 67b1065bf6494d17931f0c1cd042c5e3 (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260806 15:56:36.631261 20842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1476e13140e04607b41f18bfe2f9c9a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.631356 20985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad396afd73ed44c99daa347b0eb0a792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.631449 20843 tablet_service.cc:1467] Processing CreateTablet for tablet 67b1065bf6494d17931f0c1cd042c5e3 (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260806 15:56:36.631537 20709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67b1065bf6494d17931f0c1cd042c5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.631701 20843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67b1065bf6494d17931f0c1cd042c5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.632537 20715 tablet_service.cc:1467] Processing CreateTablet for tablet e87be408a193451bb0790b78805f074e (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260806 15:56:36.632817 20715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e87be408a193451bb0790b78805f074e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.633370 20978 tablet_service.cc:1467] Processing CreateTablet for tablet c2240136eb8549d4a227393cdae6ccc0 (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260806 15:56:36.633625 20978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2240136eb8549d4a227393cdae6ccc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.634146 20844 tablet_service.cc:1467] Processing CreateTablet for tablet c2240136eb8549d4a227393cdae6ccc0 (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260806 15:56:36.634383 20844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2240136eb8549d4a227393cdae6ccc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.634330 20982 tablet_service.cc:1467] Processing CreateTablet for tablet aa3973abeecb472193b52e51f1044630 (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260806 15:56:36.634459 20717 tablet_service.cc:1467] Processing CreateTablet for tablet ad396afd73ed44c99daa347b0eb0a792 (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260806 15:56:36.634610 20982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa3973abeecb472193b52e51f1044630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.634690 20717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad396afd73ed44c99daa347b0eb0a792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.636816 20847 tablet_service.cc:1467] Processing CreateTablet for tablet dd7e736f37cd410196d67e04dec4a1b9 (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260806 15:56:36.637069 20847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd7e736f37cd410196d67e04dec4a1b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.638291 20979 tablet_service.cc:1467] Processing CreateTablet for tablet d276369bb8c74da8aa006d3ed75c15d3 (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260806 15:56:36.638646 20979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d276369bb8c74da8aa006d3ed75c15d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.638613 20845 tablet_service.cc:1467] Processing CreateTablet for tablet d276369bb8c74da8aa006d3ed75c15d3 (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260806 15:56:36.638839 20845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d276369bb8c74da8aa006d3ed75c15d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.640285 20848 tablet_service.cc:1467] Processing CreateTablet for tablet aa3973abeecb472193b52e51f1044630 (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260806 15:56:36.640556 20848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa3973abeecb472193b52e51f1044630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.641600 20980 tablet_service.cc:1467] Processing CreateTablet for tablet 83e6a9d74d22469ebe49f3b9322e438a (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260806 15:56:36.641876 20980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83e6a9d74d22469ebe49f3b9322e438a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.642690 20849 tablet_service.cc:1467] Processing CreateTablet for tablet e87be408a193451bb0790b78805f074e (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260806 15:56:36.642946 20849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e87be408a193451bb0790b78805f074e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.644646 20846 tablet_service.cc:1467] Processing CreateTablet for tablet 83e6a9d74d22469ebe49f3b9322e438a (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260806 15:56:36.644913 20846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83e6a9d74d22469ebe49f3b9322e438a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.645121 21077 tablet_bootstrap.cc:492] T e87be408a193451bb0790b78805f074e P c6e9c56ffbd74798bcd294b8bed04c7b: Bootstrap starting.
I20260806 15:56:36.646409 21078 tablet_bootstrap.cc:492] T d276369bb8c74da8aa006d3ed75c15d3 P c8e4566a076444e3af4c37efe616fb03: Bootstrap starting.
I20260806 15:56:36.646566 20851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad396afd73ed44c99daa347b0eb0a792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.647058 20981 tablet_service.cc:1467] Processing CreateTablet for tablet dd7e736f37cd410196d67e04dec4a1b9 (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260806 15:56:36.647312 20981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd7e736f37cd410196d67e04dec4a1b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.648914 21076 tablet_bootstrap.cc:492] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15: Bootstrap starting.
I20260806 15:56:36.649137 20983 tablet_service.cc:1467] Processing CreateTablet for tablet e87be408a193451bb0790b78805f074e (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260806 15:56:36.649399 20983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e87be408a193451bb0790b78805f074e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.650300 21077 tablet_bootstrap.cc:654] T e87be408a193451bb0790b78805f074e P c6e9c56ffbd74798bcd294b8bed04c7b: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.650383 20984 tablet_service.cc:1467] Processing CreateTablet for tablet f1fa7492a9b94f90b0dab521783b52bd (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260806 15:56:36.650642 20984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1fa7492a9b94f90b0dab521783b52bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.651036 21076 tablet_bootstrap.cc:654] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.651199 21077 log.cc:824] T e87be408a193451bb0790b78805f074e P c6e9c56ffbd74798bcd294b8bed04c7b: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:36.651856 21076 log.cc:824] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:36.652215 21078 tablet_bootstrap.cc:654] T d276369bb8c74da8aa006d3ed75c15d3 P c8e4566a076444e3af4c37efe616fb03: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.652752 20850 tablet_service.cc:1467] Processing CreateTablet for tablet f1fa7492a9b94f90b0dab521783b52bd (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260806 15:56:36.653047 20850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1fa7492a9b94f90b0dab521783b52bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.653087 21078 log.cc:824] T d276369bb8c74da8aa006d3ed75c15d3 P c8e4566a076444e3af4c37efe616fb03: Log is configured to *not* fsync() on all Append() calls
I20260806 15:56:36.654309 20712 tablet_service.cc:1467] Processing CreateTablet for tablet 83e6a9d74d22469ebe49f3b9322e438a (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260806 15:56:36.654460 21076 tablet_bootstrap.cc:492] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15: No bootstrap required, opened a new log
I20260806 15:56:36.654616 20712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83e6a9d74d22469ebe49f3b9322e438a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.654655 21076 ts_tablet_manager.cc:1397] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 15:56:36.655416 20711 tablet_service.cc:1467] Processing CreateTablet for tablet d276369bb8c74da8aa006d3ed75c15d3 (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260806 15:56:36.655686 20711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d276369bb8c74da8aa006d3ed75c15d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.656131 21078 tablet_bootstrap.cc:492] T d276369bb8c74da8aa006d3ed75c15d3 P c8e4566a076444e3af4c37efe616fb03: No bootstrap required, opened a new log
I20260806 15:56:36.656312 21078 ts_tablet_manager.cc:1397] T d276369bb8c74da8aa006d3ed75c15d3 P c8e4566a076444e3af4c37efe616fb03: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260806 15:56:36.657204 21077 tablet_bootstrap.cc:492] T e87be408a193451bb0790b78805f074e P c6e9c56ffbd74798bcd294b8bed04c7b: No bootstrap required, opened a new log
I20260806 15:56:36.657377 21077 ts_tablet_manager.cc:1397] T e87be408a193451bb0790b78805f074e P c6e9c56ffbd74798bcd294b8bed04c7b: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.002s
I20260806 15:56:36.657970 20713 tablet_service.cc:1467] Processing CreateTablet for tablet dd7e736f37cd410196d67e04dec4a1b9 (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260806 15:56:36.658290 20713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd7e736f37cd410196d67e04dec4a1b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.660279 21077 raft_consensus.cc:348] T e87be408a193451bb0790b78805f074e P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.660298 21076 raft_consensus.cc:348] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.660470 20714 tablet_service.cc:1467] Processing CreateTablet for tablet aa3973abeecb472193b52e51f1044630 (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260806 15:56:36.660581 21076 raft_consensus.cc:729] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.660589 21077 raft_consensus.cc:729] T e87be408a193451bb0790b78805f074e P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e9c56ffbd74798bcd294b8bed04c7b, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.660739 20714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa3973abeecb472193b52e51f1044630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.660910 21076 consensus_queue.cc:260] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.660909 21077 consensus_queue.cc:260] T e87be408a193451bb0790b78805f074e P c6e9c56ffbd74798bcd294b8bed04c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.662020 21077 ts_tablet_manager.cc:1428] T e87be408a193451bb0790b78805f074e P c6e9c56ffbd74798bcd294b8bed04c7b: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260806 15:56:36.662034 21076 ts_tablet_manager.cc:1428] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260806 15:56:36.662412 20919 heartbeater.cc:503] Master 127.10.189.254:33127 was elected leader, sending a full tablet report...
I20260806 15:56:36.662416 20784 heartbeater.cc:503] Master 127.10.189.254:33127 was elected leader, sending a full tablet report...
I20260806 15:56:36.663409 20716 tablet_service.cc:1467] Processing CreateTablet for tablet f1fa7492a9b94f90b0dab521783b52bd (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260806 15:56:36.663686 20716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1fa7492a9b94f90b0dab521783b52bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.663836 21076 tablet_bootstrap.cc:492] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15: Bootstrap starting.
I20260806 15:56:36.664947 21076 tablet_bootstrap.cc:654] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.664839 21078 raft_consensus.cc:348] T d276369bb8c74da8aa006d3ed75c15d3 P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.665150 21078 raft_consensus.cc:729] T d276369bb8c74da8aa006d3ed75c15d3 P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e4566a076444e3af4c37efe616fb03, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.665540 21078 consensus_queue.cc:260] T d276369bb8c74da8aa006d3ed75c15d3 P c8e4566a076444e3af4c37efe616fb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.666167 21076 tablet_bootstrap.cc:492] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15: No bootstrap required, opened a new log
I20260806 15:56:36.630316 20976 tablet_service.cc:1467] Processing CreateTablet for tablet 1476e13140e04607b41f18bfe2f9c9a0 (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260806 15:56:36.666249 21076 ts_tablet_manager.cc:1397] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260806 15:56:36.666404 20976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1476e13140e04607b41f18bfe2f9c9a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.666661 21078 ts_tablet_manager.cc:1428] T d276369bb8c74da8aa006d3ed75c15d3 P c8e4566a076444e3af4c37efe616fb03: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260806 15:56:36.666864 21076 raft_consensus.cc:348] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.666963 21076 raft_consensus.cc:729] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.667011 21078 tablet_bootstrap.cc:492] T c2240136eb8549d4a227393cdae6ccc0 P c8e4566a076444e3af4c37efe616fb03: Bootstrap starting.
I20260806 15:56:36.667055 21054 heartbeater.cc:503] Master 127.10.189.254:33127 was elected leader, sending a full tablet report...
I20260806 15:56:36.667075 21076 consensus_queue.cc:260] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.667425 21076 ts_tablet_manager.cc:1428] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:56:36.667609 21076 tablet_bootstrap.cc:492] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15: Bootstrap starting.
I20260806 15:56:36.667989 21078 tablet_bootstrap.cc:654] T c2240136eb8549d4a227393cdae6ccc0 P c8e4566a076444e3af4c37efe616fb03: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.668534 21076 tablet_bootstrap.cc:654] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.668649 21077 tablet_bootstrap.cc:492] T ad396afd73ed44c99daa347b0eb0a792 P c6e9c56ffbd74798bcd294b8bed04c7b: Bootstrap starting.
I20260806 15:56:36.668859 20977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67b1065bf6494d17931f0c1cd042c5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.669598 21078 tablet_bootstrap.cc:492] T c2240136eb8549d4a227393cdae6ccc0 P c8e4566a076444e3af4c37efe616fb03: No bootstrap required, opened a new log
I20260806 15:56:36.669682 21078 ts_tablet_manager.cc:1397] T c2240136eb8549d4a227393cdae6ccc0 P c8e4566a076444e3af4c37efe616fb03: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 15:56:36.669699 21077 tablet_bootstrap.cc:654] T ad396afd73ed44c99daa347b0eb0a792 P c6e9c56ffbd74798bcd294b8bed04c7b: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.670339 21078 raft_consensus.cc:348] T c2240136eb8549d4a227393cdae6ccc0 P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.670470 21078 raft_consensus.cc:729] T c2240136eb8549d4a227393cdae6ccc0 P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e4566a076444e3af4c37efe616fb03, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.670574 21078 consensus_queue.cc:260] T c2240136eb8549d4a227393cdae6ccc0 P c8e4566a076444e3af4c37efe616fb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.670827 21078 ts_tablet_manager.cc:1428] T c2240136eb8549d4a227393cdae6ccc0 P c8e4566a076444e3af4c37efe616fb03: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:56:36.670850 21077 tablet_bootstrap.cc:492] T ad396afd73ed44c99daa347b0eb0a792 P c6e9c56ffbd74798bcd294b8bed04c7b: No bootstrap required, opened a new log
I20260806 15:56:36.670922 21077 ts_tablet_manager.cc:1397] T ad396afd73ed44c99daa347b0eb0a792 P c6e9c56ffbd74798bcd294b8bed04c7b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:56:36.670991 21078 tablet_bootstrap.cc:492] T aa3973abeecb472193b52e51f1044630 P c8e4566a076444e3af4c37efe616fb03: Bootstrap starting.
I20260806 15:56:36.630025 20710 tablet_service.cc:1467] Processing CreateTablet for tablet c2240136eb8549d4a227393cdae6ccc0 (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260806 15:56:36.671481 20710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2240136eb8549d4a227393cdae6ccc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.671532 21077 raft_consensus.cc:348] T ad396afd73ed44c99daa347b0eb0a792 P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } } peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } }
I20260806 15:56:36.671638 21077 raft_consensus.cc:729] T ad396afd73ed44c99daa347b0eb0a792 P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e9c56ffbd74798bcd294b8bed04c7b, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.671730 21077 consensus_queue.cc:260] T ad396afd73ed44c99daa347b0eb0a792 P c6e9c56ffbd74798bcd294b8bed04c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } } peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } }
I20260806 15:56:36.671875 21078 tablet_bootstrap.cc:654] T aa3973abeecb472193b52e51f1044630 P c8e4566a076444e3af4c37efe616fb03: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.672058 21077 ts_tablet_manager.cc:1428] T ad396afd73ed44c99daa347b0eb0a792 P c6e9c56ffbd74798bcd294b8bed04c7b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:56:36.672228 21077 tablet_bootstrap.cc:492] T 67b1065bf6494d17931f0c1cd042c5e3 P c6e9c56ffbd74798bcd294b8bed04c7b: Bootstrap starting.
I20260806 15:56:36.673059 21078 tablet_bootstrap.cc:492] T aa3973abeecb472193b52e51f1044630 P c8e4566a076444e3af4c37efe616fb03: No bootstrap required, opened a new log
I20260806 15:56:36.673139 21078 ts_tablet_manager.cc:1397] T aa3973abeecb472193b52e51f1044630 P c8e4566a076444e3af4c37efe616fb03: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:56:36.673188 21077 tablet_bootstrap.cc:654] T 67b1065bf6494d17931f0c1cd042c5e3 P c6e9c56ffbd74798bcd294b8bed04c7b: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.673609 21076 tablet_bootstrap.cc:492] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15: No bootstrap required, opened a new log
I20260806 15:56:36.673691 21076 ts_tablet_manager.cc:1397] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260806 15:56:36.673897 21078 raft_consensus.cc:348] T aa3973abeecb472193b52e51f1044630 P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.674006 21078 raft_consensus.cc:729] T aa3973abeecb472193b52e51f1044630 P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e4566a076444e3af4c37efe616fb03, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.674157 21078 consensus_queue.cc:260] T aa3973abeecb472193b52e51f1044630 P c8e4566a076444e3af4c37efe616fb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.674165 21076 raft_consensus.cc:348] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.674261 21076 raft_consensus.cc:729] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.674347 21076 consensus_queue.cc:260] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.674472 21078 ts_tablet_manager.cc:1428] T aa3973abeecb472193b52e51f1044630 P c8e4566a076444e3af4c37efe616fb03: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260806 15:56:36.674635 21078 tablet_bootstrap.cc:492] T 83e6a9d74d22469ebe49f3b9322e438a P c8e4566a076444e3af4c37efe616fb03: Bootstrap starting.
I20260806 15:56:36.674696 21076 ts_tablet_manager.cc:1428] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:56:36.674850 21076 tablet_bootstrap.cc:492] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15: Bootstrap starting.
I20260806 15:56:36.675631 21078 tablet_bootstrap.cc:654] T 83e6a9d74d22469ebe49f3b9322e438a P c8e4566a076444e3af4c37efe616fb03: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.675733 21076 tablet_bootstrap.cc:654] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.676841 21078 tablet_bootstrap.cc:492] T 83e6a9d74d22469ebe49f3b9322e438a P c8e4566a076444e3af4c37efe616fb03: No bootstrap required, opened a new log
I20260806 15:56:36.676920 21078 ts_tablet_manager.cc:1397] T 83e6a9d74d22469ebe49f3b9322e438a P c8e4566a076444e3af4c37efe616fb03: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:56:36.677048 21076 tablet_bootstrap.cc:492] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15: No bootstrap required, opened a new log
I20260806 15:56:36.677127 21076 ts_tablet_manager.cc:1397] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:56:36.677335 21078 raft_consensus.cc:348] T 83e6a9d74d22469ebe49f3b9322e438a P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.677460 21078 raft_consensus.cc:729] T 83e6a9d74d22469ebe49f3b9322e438a P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e4566a076444e3af4c37efe616fb03, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.677524 21076 raft_consensus.cc:348] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.677560 21078 consensus_queue.cc:260] T 83e6a9d74d22469ebe49f3b9322e438a P c8e4566a076444e3af4c37efe616fb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.677625 21076 raft_consensus.cc:729] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.677716 21076 consensus_queue.cc:260] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.677861 21078 ts_tablet_manager.cc:1428] T 83e6a9d74d22469ebe49f3b9322e438a P c8e4566a076444e3af4c37efe616fb03: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:56:36.677981 21076 ts_tablet_manager.cc:1428] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:56:36.678011 21078 tablet_bootstrap.cc:492] T ad396afd73ed44c99daa347b0eb0a792 P c8e4566a076444e3af4c37efe616fb03: Bootstrap starting.
I20260806 15:56:36.678165 21076 tablet_bootstrap.cc:492] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15: Bootstrap starting.
I20260806 15:56:36.678956 21078 tablet_bootstrap.cc:654] T ad396afd73ed44c99daa347b0eb0a792 P c8e4566a076444e3af4c37efe616fb03: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.679101 21076 tablet_bootstrap.cc:654] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.630028 20708 tablet_service.cc:1467] Processing CreateTablet for tablet 1476e13140e04607b41f18bfe2f9c9a0 (DEFAULT_TABLE table=test-workload [id=606a60295a0d474aa372fc2b3240c8b1]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260806 15:56:36.679930 20708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1476e13140e04607b41f18bfe2f9c9a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:56:36.680130 21078 tablet_bootstrap.cc:492] T ad396afd73ed44c99daa347b0eb0a792 P c8e4566a076444e3af4c37efe616fb03: No bootstrap required, opened a new log
I20260806 15:56:36.680200 21078 ts_tablet_manager.cc:1397] T ad396afd73ed44c99daa347b0eb0a792 P c8e4566a076444e3af4c37efe616fb03: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:56:36.680460 21076 tablet_bootstrap.cc:492] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15: No bootstrap required, opened a new log
I20260806 15:56:36.680538 21076 ts_tablet_manager.cc:1397] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:56:36.680612 21078 raft_consensus.cc:348] T ad396afd73ed44c99daa347b0eb0a792 P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } } peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } }
I20260806 15:56:36.680707 21078 raft_consensus.cc:729] T ad396afd73ed44c99daa347b0eb0a792 P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e4566a076444e3af4c37efe616fb03, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.680791 21078 consensus_queue.cc:260] T ad396afd73ed44c99daa347b0eb0a792 P c8e4566a076444e3af4c37efe616fb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } } peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } }
I20260806 15:56:36.680919 21076 raft_consensus.cc:348] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.681012 21076 raft_consensus.cc:729] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.681051 21078 ts_tablet_manager.cc:1428] T ad396afd73ed44c99daa347b0eb0a792 P c8e4566a076444e3af4c37efe616fb03: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:56:36.681099 21076 consensus_queue.cc:260] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.681202 21078 tablet_bootstrap.cc:492] T dd7e736f37cd410196d67e04dec4a1b9 P c8e4566a076444e3af4c37efe616fb03: Bootstrap starting.
I20260806 15:56:36.681406 21076 ts_tablet_manager.cc:1428] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:56:36.681556 21076 tablet_bootstrap.cc:492] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15: Bootstrap starting.
I20260806 15:56:36.682293 21078 tablet_bootstrap.cc:654] T dd7e736f37cd410196d67e04dec4a1b9 P c8e4566a076444e3af4c37efe616fb03: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.682541 21076 tablet_bootstrap.cc:654] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15: Neither blocks nor log segments found. Creating new log.
W20260806 15:56:36.683231 20785 tablet.cc:2369] T ad396afd73ed44c99daa347b0eb0a792 P c6e9c56ffbd74798bcd294b8bed04c7b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:56:36.683341 21078 tablet_bootstrap.cc:492] T dd7e736f37cd410196d67e04dec4a1b9 P c8e4566a076444e3af4c37efe616fb03: No bootstrap required, opened a new log
I20260806 15:56:36.683418 21078 ts_tablet_manager.cc:1397] T dd7e736f37cd410196d67e04dec4a1b9 P c8e4566a076444e3af4c37efe616fb03: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260806 15:56:36.683853 21078 raft_consensus.cc:348] T dd7e736f37cd410196d67e04dec4a1b9 P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.683985 21078 raft_consensus.cc:729] T dd7e736f37cd410196d67e04dec4a1b9 P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e4566a076444e3af4c37efe616fb03, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.684108 21078 consensus_queue.cc:260] T dd7e736f37cd410196d67e04dec4a1b9 P c8e4566a076444e3af4c37efe616fb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.684419 21078 ts_tablet_manager.cc:1428] T dd7e736f37cd410196d67e04dec4a1b9 P c8e4566a076444e3af4c37efe616fb03: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260806 15:56:36.684546 21076 tablet_bootstrap.cc:492] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15: No bootstrap required, opened a new log
I20260806 15:56:36.684577 21078 tablet_bootstrap.cc:492] T f1fa7492a9b94f90b0dab521783b52bd P c8e4566a076444e3af4c37efe616fb03: Bootstrap starting.
I20260806 15:56:36.685700 21078 tablet_bootstrap.cc:654] T f1fa7492a9b94f90b0dab521783b52bd P c8e4566a076444e3af4c37efe616fb03: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.686162 21076 ts_tablet_manager.cc:1397] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260806 15:56:36.686825 21076 raft_consensus.cc:348] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.687005 21076 raft_consensus.cc:729] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.687150 21078 tablet_bootstrap.cc:492] T f1fa7492a9b94f90b0dab521783b52bd P c8e4566a076444e3af4c37efe616fb03: No bootstrap required, opened a new log
I20260806 15:56:36.687125 21076 consensus_queue.cc:260] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.687239 21078 ts_tablet_manager.cc:1397] T f1fa7492a9b94f90b0dab521783b52bd P c8e4566a076444e3af4c37efe616fb03: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260806 15:56:36.687496 21076 ts_tablet_manager.cc:1428] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:56:36.687685 21076 tablet_bootstrap.cc:492] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15: Bootstrap starting.
I20260806 15:56:36.687664 21078 raft_consensus.cc:348] T f1fa7492a9b94f90b0dab521783b52bd P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.687779 21078 raft_consensus.cc:729] T f1fa7492a9b94f90b0dab521783b52bd P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e4566a076444e3af4c37efe616fb03, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.687907 21078 consensus_queue.cc:260] T f1fa7492a9b94f90b0dab521783b52bd P c8e4566a076444e3af4c37efe616fb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.688166 21078 ts_tablet_manager.cc:1428] T f1fa7492a9b94f90b0dab521783b52bd P c8e4566a076444e3af4c37efe616fb03: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:56:36.688335 21078 tablet_bootstrap.cc:492] T 1476e13140e04607b41f18bfe2f9c9a0 P c8e4566a076444e3af4c37efe616fb03: Bootstrap starting.
I20260806 15:56:36.688743 21076 tablet_bootstrap.cc:654] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.688905 21077 tablet_bootstrap.cc:492] T 67b1065bf6494d17931f0c1cd042c5e3 P c6e9c56ffbd74798bcd294b8bed04c7b: No bootstrap required, opened a new log
I20260806 15:56:36.689009 21077 ts_tablet_manager.cc:1397] T 67b1065bf6494d17931f0c1cd042c5e3 P c6e9c56ffbd74798bcd294b8bed04c7b: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.000s
I20260806 15:56:36.689257 21078 tablet_bootstrap.cc:654] T 1476e13140e04607b41f18bfe2f9c9a0 P c8e4566a076444e3af4c37efe616fb03: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.689795 21077 raft_consensus.cc:348] T 67b1065bf6494d17931f0c1cd042c5e3 P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.689919 21077 raft_consensus.cc:729] T 67b1065bf6494d17931f0c1cd042c5e3 P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e9c56ffbd74798bcd294b8bed04c7b, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.690032 21077 consensus_queue.cc:260] T 67b1065bf6494d17931f0c1cd042c5e3 P c6e9c56ffbd74798bcd294b8bed04c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.690407 21077 ts_tablet_manager.cc:1428] T 67b1065bf6494d17931f0c1cd042c5e3 P c6e9c56ffbd74798bcd294b8bed04c7b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:56:36.690752 21077 tablet_bootstrap.cc:492] T 83e6a9d74d22469ebe49f3b9322e438a P c6e9c56ffbd74798bcd294b8bed04c7b: Bootstrap starting.
I20260806 15:56:36.691155 21078 tablet_bootstrap.cc:492] T 1476e13140e04607b41f18bfe2f9c9a0 P c8e4566a076444e3af4c37efe616fb03: No bootstrap required, opened a new log
I20260806 15:56:36.691251 21078 ts_tablet_manager.cc:1397] T 1476e13140e04607b41f18bfe2f9c9a0 P c8e4566a076444e3af4c37efe616fb03: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260806 15:56:36.691736 21077 tablet_bootstrap.cc:654] T 83e6a9d74d22469ebe49f3b9322e438a P c6e9c56ffbd74798bcd294b8bed04c7b: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.691685 21078 raft_consensus.cc:348] T 1476e13140e04607b41f18bfe2f9c9a0 P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.691792 21078 raft_consensus.cc:729] T 1476e13140e04607b41f18bfe2f9c9a0 P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e4566a076444e3af4c37efe616fb03, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.691898 21078 consensus_queue.cc:260] T 1476e13140e04607b41f18bfe2f9c9a0 P c8e4566a076444e3af4c37efe616fb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.692188 21078 ts_tablet_manager.cc:1428] T 1476e13140e04607b41f18bfe2f9c9a0 P c8e4566a076444e3af4c37efe616fb03: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:56:36.692354 21078 tablet_bootstrap.cc:492] T 67b1065bf6494d17931f0c1cd042c5e3 P c8e4566a076444e3af4c37efe616fb03: Bootstrap starting.
I20260806 15:56:36.693259 21078 tablet_bootstrap.cc:654] T 67b1065bf6494d17931f0c1cd042c5e3 P c8e4566a076444e3af4c37efe616fb03: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.693377 21077 tablet_bootstrap.cc:492] T 83e6a9d74d22469ebe49f3b9322e438a P c6e9c56ffbd74798bcd294b8bed04c7b: No bootstrap required, opened a new log
I20260806 15:56:36.693470 21077 ts_tablet_manager.cc:1397] T 83e6a9d74d22469ebe49f3b9322e438a P c6e9c56ffbd74798bcd294b8bed04c7b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 15:56:36.693956 21077 raft_consensus.cc:348] T 83e6a9d74d22469ebe49f3b9322e438a P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.694149 21077 raft_consensus.cc:729] T 83e6a9d74d22469ebe49f3b9322e438a P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e9c56ffbd74798bcd294b8bed04c7b, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.694247 21077 consensus_queue.cc:260] T 83e6a9d74d22469ebe49f3b9322e438a P c6e9c56ffbd74798bcd294b8bed04c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.694523 21077 ts_tablet_manager.cc:1428] T 83e6a9d74d22469ebe49f3b9322e438a P c6e9c56ffbd74798bcd294b8bed04c7b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:56:36.694689 21077 tablet_bootstrap.cc:492] T d276369bb8c74da8aa006d3ed75c15d3 P c6e9c56ffbd74798bcd294b8bed04c7b: Bootstrap starting.
I20260806 15:56:36.694957 21076 tablet_bootstrap.cc:492] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15: No bootstrap required, opened a new log
I20260806 15:56:36.695046 21076 ts_tablet_manager.cc:1397] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260806 15:56:36.695657 21077 tablet_bootstrap.cc:654] T d276369bb8c74da8aa006d3ed75c15d3 P c6e9c56ffbd74798bcd294b8bed04c7b: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.695514 21076 raft_consensus.cc:348] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } } peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } }
I20260806 15:56:36.695701 21076 raft_consensus.cc:729] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.695799 21076 consensus_queue.cc:260] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } } peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } }
I20260806 15:56:36.696092 21076 ts_tablet_manager.cc:1428] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:56:36.696277 21076 tablet_bootstrap.cc:492] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15: Bootstrap starting.
I20260806 15:56:36.697230 21076 tablet_bootstrap.cc:654] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.698428 21078 tablet_bootstrap.cc:492] T 67b1065bf6494d17931f0c1cd042c5e3 P c8e4566a076444e3af4c37efe616fb03: No bootstrap required, opened a new log
I20260806 15:56:36.698521 21078 ts_tablet_manager.cc:1397] T 67b1065bf6494d17931f0c1cd042c5e3 P c8e4566a076444e3af4c37efe616fb03: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260806 15:56:36.698942 21078 raft_consensus.cc:348] T 67b1065bf6494d17931f0c1cd042c5e3 P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.699064 21078 raft_consensus.cc:729] T 67b1065bf6494d17931f0c1cd042c5e3 P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e4566a076444e3af4c37efe616fb03, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.699152 21078 consensus_queue.cc:260] T 67b1065bf6494d17931f0c1cd042c5e3 P c8e4566a076444e3af4c37efe616fb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.699427 21078 ts_tablet_manager.cc:1428] T 67b1065bf6494d17931f0c1cd042c5e3 P c8e4566a076444e3af4c37efe616fb03: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260806 15:56:36.699620 21078 tablet_bootstrap.cc:492] T e87be408a193451bb0790b78805f074e P c8e4566a076444e3af4c37efe616fb03: Bootstrap starting.
I20260806 15:56:36.700443 21076 tablet_bootstrap.cc:492] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15: No bootstrap required, opened a new log
I20260806 15:56:36.700528 21076 ts_tablet_manager.cc:1397] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260806 15:56:36.700762 21078 tablet_bootstrap.cc:654] T e87be408a193451bb0790b78805f074e P c8e4566a076444e3af4c37efe616fb03: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.700973 21076 raft_consensus.cc:348] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.701089 21076 raft_consensus.cc:729] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.701184 21076 consensus_queue.cc:260] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.701500 21076 ts_tablet_manager.cc:1428] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:56:36.701676 21076 tablet_bootstrap.cc:492] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15: Bootstrap starting.
I20260806 15:56:36.701928 21077 tablet_bootstrap.cc:492] T d276369bb8c74da8aa006d3ed75c15d3 P c6e9c56ffbd74798bcd294b8bed04c7b: No bootstrap required, opened a new log
I20260806 15:56:36.702020 21077 ts_tablet_manager.cc:1397] T d276369bb8c74da8aa006d3ed75c15d3 P c6e9c56ffbd74798bcd294b8bed04c7b: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260806 15:56:36.702484 21078 tablet_bootstrap.cc:492] T e87be408a193451bb0790b78805f074e P c8e4566a076444e3af4c37efe616fb03: No bootstrap required, opened a new log
I20260806 15:56:36.702569 21078 ts_tablet_manager.cc:1397] T e87be408a193451bb0790b78805f074e P c8e4566a076444e3af4c37efe616fb03: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260806 15:56:36.702620 21076 tablet_bootstrap.cc:654] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.702590 21077 raft_consensus.cc:348] T d276369bb8c74da8aa006d3ed75c15d3 P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.702718 21077 raft_consensus.cc:729] T d276369bb8c74da8aa006d3ed75c15d3 P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e9c56ffbd74798bcd294b8bed04c7b, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.702808 21077 consensus_queue.cc:260] T d276369bb8c74da8aa006d3ed75c15d3 P c6e9c56ffbd74798bcd294b8bed04c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.702988 21078 raft_consensus.cc:348] T e87be408a193451bb0790b78805f074e P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.703088 21078 raft_consensus.cc:729] T e87be408a193451bb0790b78805f074e P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e4566a076444e3af4c37efe616fb03, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.703176 21078 consensus_queue.cc:260] T e87be408a193451bb0790b78805f074e P c8e4566a076444e3af4c37efe616fb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.703433 21078 ts_tablet_manager.cc:1428] T e87be408a193451bb0790b78805f074e P c8e4566a076444e3af4c37efe616fb03: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 15:56:36.704041 21077 ts_tablet_manager.cc:1428] T d276369bb8c74da8aa006d3ed75c15d3 P c6e9c56ffbd74798bcd294b8bed04c7b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:56:36.704234 21077 tablet_bootstrap.cc:492] T dd7e736f37cd410196d67e04dec4a1b9 P c6e9c56ffbd74798bcd294b8bed04c7b: Bootstrap starting.
I20260806 15:56:36.705161 21076 tablet_bootstrap.cc:492] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15: No bootstrap required, opened a new log
I20260806 15:56:36.705201 21077 tablet_bootstrap.cc:654] T dd7e736f37cd410196d67e04dec4a1b9 P c6e9c56ffbd74798bcd294b8bed04c7b: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.705240 21076 ts_tablet_manager.cc:1397] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260806 15:56:36.705662 21076 raft_consensus.cc:348] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.705785 21076 raft_consensus.cc:729] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.705899 21076 consensus_queue.cc:260] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.706664 21076 ts_tablet_manager.cc:1428] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260806 15:56:36.706745 21077 tablet_bootstrap.cc:492] T dd7e736f37cd410196d67e04dec4a1b9 P c6e9c56ffbd74798bcd294b8bed04c7b: No bootstrap required, opened a new log
I20260806 15:56:36.706836 21077 ts_tablet_manager.cc:1397] T dd7e736f37cd410196d67e04dec4a1b9 P c6e9c56ffbd74798bcd294b8bed04c7b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 15:56:36.706848 21076 tablet_bootstrap.cc:492] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15: Bootstrap starting.
I20260806 15:56:36.707300 21077 raft_consensus.cc:348] T dd7e736f37cd410196d67e04dec4a1b9 P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.707409 21077 raft_consensus.cc:729] T dd7e736f37cd410196d67e04dec4a1b9 P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e9c56ffbd74798bcd294b8bed04c7b, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.707507 21077 consensus_queue.cc:260] T dd7e736f37cd410196d67e04dec4a1b9 P c6e9c56ffbd74798bcd294b8bed04c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.707744 21077 ts_tablet_manager.cc:1428] T dd7e736f37cd410196d67e04dec4a1b9 P c6e9c56ffbd74798bcd294b8bed04c7b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 15:56:36.707785 21076 tablet_bootstrap.cc:654] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.707881 21077 tablet_bootstrap.cc:492] T aa3973abeecb472193b52e51f1044630 P c6e9c56ffbd74798bcd294b8bed04c7b: Bootstrap starting.
I20260806 15:56:36.708818 21076 tablet_bootstrap.cc:492] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15: No bootstrap required, opened a new log
I20260806 15:56:36.708910 21076 ts_tablet_manager.cc:1397] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260806 15:56:36.708940 21077 tablet_bootstrap.cc:654] T aa3973abeecb472193b52e51f1044630 P c6e9c56ffbd74798bcd294b8bed04c7b: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.709371 21076 raft_consensus.cc:348] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.709475 21076 raft_consensus.cc:729] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.709575 21076 consensus_queue.cc:260] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.709836 21076 ts_tablet_manager.cc:1428] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:56:36.710141 21077 tablet_bootstrap.cc:492] T aa3973abeecb472193b52e51f1044630 P c6e9c56ffbd74798bcd294b8bed04c7b: No bootstrap required, opened a new log
I20260806 15:56:36.710240 21077 ts_tablet_manager.cc:1397] T aa3973abeecb472193b52e51f1044630 P c6e9c56ffbd74798bcd294b8bed04c7b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:56:36.710666 21077 raft_consensus.cc:348] T aa3973abeecb472193b52e51f1044630 P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.710788 21077 raft_consensus.cc:729] T aa3973abeecb472193b52e51f1044630 P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e9c56ffbd74798bcd294b8bed04c7b, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.710889 21077 consensus_queue.cc:260] T aa3973abeecb472193b52e51f1044630 P c6e9c56ffbd74798bcd294b8bed04c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.711182 21077 ts_tablet_manager.cc:1428] T aa3973abeecb472193b52e51f1044630 P c6e9c56ffbd74798bcd294b8bed04c7b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 15:56:36.711362 21077 tablet_bootstrap.cc:492] T f1fa7492a9b94f90b0dab521783b52bd P c6e9c56ffbd74798bcd294b8bed04c7b: Bootstrap starting.
I20260806 15:56:36.712246 21077 tablet_bootstrap.cc:654] T f1fa7492a9b94f90b0dab521783b52bd P c6e9c56ffbd74798bcd294b8bed04c7b: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.713397 21077 tablet_bootstrap.cc:492] T f1fa7492a9b94f90b0dab521783b52bd P c6e9c56ffbd74798bcd294b8bed04c7b: No bootstrap required, opened a new log
I20260806 15:56:36.713495 21077 ts_tablet_manager.cc:1397] T f1fa7492a9b94f90b0dab521783b52bd P c6e9c56ffbd74798bcd294b8bed04c7b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:56:36.713940 21077 raft_consensus.cc:348] T f1fa7492a9b94f90b0dab521783b52bd P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.714058 21077 raft_consensus.cc:729] T f1fa7492a9b94f90b0dab521783b52bd P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e9c56ffbd74798bcd294b8bed04c7b, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.714182 21077 consensus_queue.cc:260] T f1fa7492a9b94f90b0dab521783b52bd P c6e9c56ffbd74798bcd294b8bed04c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.714460 21077 ts_tablet_manager.cc:1428] T f1fa7492a9b94f90b0dab521783b52bd P c6e9c56ffbd74798bcd294b8bed04c7b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:56:36.714643 21077 tablet_bootstrap.cc:492] T c2240136eb8549d4a227393cdae6ccc0 P c6e9c56ffbd74798bcd294b8bed04c7b: Bootstrap starting.
I20260806 15:56:36.715579 21077 tablet_bootstrap.cc:654] T c2240136eb8549d4a227393cdae6ccc0 P c6e9c56ffbd74798bcd294b8bed04c7b: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.716889 21077 tablet_bootstrap.cc:492] T c2240136eb8549d4a227393cdae6ccc0 P c6e9c56ffbd74798bcd294b8bed04c7b: No bootstrap required, opened a new log
I20260806 15:56:36.716958 21077 ts_tablet_manager.cc:1397] T c2240136eb8549d4a227393cdae6ccc0 P c6e9c56ffbd74798bcd294b8bed04c7b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:56:36.717425 21077 raft_consensus.cc:348] T c2240136eb8549d4a227393cdae6ccc0 P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.717549 21077 raft_consensus.cc:729] T c2240136eb8549d4a227393cdae6ccc0 P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e9c56ffbd74798bcd294b8bed04c7b, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.717649 21077 consensus_queue.cc:260] T c2240136eb8549d4a227393cdae6ccc0 P c6e9c56ffbd74798bcd294b8bed04c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.717898 21077 ts_tablet_manager.cc:1428] T c2240136eb8549d4a227393cdae6ccc0 P c6e9c56ffbd74798bcd294b8bed04c7b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 15:56:36.718144 21077 tablet_bootstrap.cc:492] T 1476e13140e04607b41f18bfe2f9c9a0 P c6e9c56ffbd74798bcd294b8bed04c7b: Bootstrap starting.
I20260806 15:56:36.719475 21077 tablet_bootstrap.cc:654] T 1476e13140e04607b41f18bfe2f9c9a0 P c6e9c56ffbd74798bcd294b8bed04c7b: Neither blocks nor log segments found. Creating new log.
I20260806 15:56:36.720610 21077 tablet_bootstrap.cc:492] T 1476e13140e04607b41f18bfe2f9c9a0 P c6e9c56ffbd74798bcd294b8bed04c7b: No bootstrap required, opened a new log
I20260806 15:56:36.720688 21077 ts_tablet_manager.cc:1397] T 1476e13140e04607b41f18bfe2f9c9a0 P c6e9c56ffbd74798bcd294b8bed04c7b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 15:56:36.721114 21077 raft_consensus.cc:348] T 1476e13140e04607b41f18bfe2f9c9a0 P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.721197 21077 raft_consensus.cc:729] T 1476e13140e04607b41f18bfe2f9c9a0 P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e9c56ffbd74798bcd294b8bed04c7b, State: Initialized, Role: FOLLOWER
I20260806 15:56:36.721287 21077 consensus_queue.cc:260] T 1476e13140e04607b41f18bfe2f9c9a0 P c6e9c56ffbd74798bcd294b8bed04c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.721544 21077 ts_tablet_manager.cc:1428] T 1476e13140e04607b41f18bfe2f9c9a0 P c6e9c56ffbd74798bcd294b8bed04c7b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 15:56:36.745491 20873 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1476e13140e04607b41f18bfe2f9c9a0"
dest_uuid: "559a99d65dfa41c7a118f5f7b5378b15"
from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.745743 20873 raft_consensus.cc:482] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:36.745891 20873 raft_consensus.cc:3037] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.747023 20873 raft_consensus.cc:504] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.748117 20873 leader_election.cc:288] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15 [CANDIDATE]: Term 1 election: Requested vote from peers c6e9c56ffbd74798bcd294b8bed04c7b (127.10.189.193:36689), c8e4566a076444e3af4c37efe616fb03 (127.10.189.195:36829)
I20260806 15:56:36.752912 21006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1476e13140e04607b41f18bfe2f9c9a0" candidate_uuid: "559a99d65dfa41c7a118f5f7b5378b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c8e4566a076444e3af4c37efe616fb03"
I20260806 15:56:36.753147 21006 raft_consensus.cc:3037] T 1476e13140e04607b41f18bfe2f9c9a0 P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.753860 20738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1476e13140e04607b41f18bfe2f9c9a0" candidate_uuid: "559a99d65dfa41c7a118f5f7b5378b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b"
I20260806 15:56:36.754051 20738 raft_consensus.cc:3037] T 1476e13140e04607b41f18bfe2f9c9a0 P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.754514 21006 raft_consensus.cc:2454] T 1476e13140e04607b41f18bfe2f9c9a0 P c8e4566a076444e3af4c37efe616fb03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 559a99d65dfa41c7a118f5f7b5378b15 in term 1.
I20260806 15:56:36.754921 20804 leader_election.cc:302] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 559a99d65dfa41c7a118f5f7b5378b15, c8e4566a076444e3af4c37efe616fb03; no voters:
I20260806 15:56:36.755229 21086 raft_consensus.cc:2781] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:36.755266 20738 raft_consensus.cc:2454] T 1476e13140e04607b41f18bfe2f9c9a0 P c6e9c56ffbd74798bcd294b8bed04c7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 559a99d65dfa41c7a118f5f7b5378b15 in term 1.
I20260806 15:56:36.755355 21086 raft_consensus.cc:686] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Becoming Leader. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Running, Role: LEADER
I20260806 15:56:36.755744 21086 consensus_queue.cc:237] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.758841 20591 catalog_manager.cc:5495] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15 reported cstate change: term changed from 0 to 1, leader changed from <none> to 559a99d65dfa41c7a118f5f7b5378b15 (127.10.189.194). New cstate: current_term: 1 leader_uuid: "559a99d65dfa41c7a118f5f7b5378b15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } health_report { overall_health: UNKNOWN } } }
I20260806 15:56:36.764339 20873 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c2240136eb8549d4a227393cdae6ccc0"
dest_uuid: "559a99d65dfa41c7a118f5f7b5378b15"
from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.764467 20873 raft_consensus.cc:482] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:36.764529 20873 raft_consensus.cc:3037] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.765314 20873 raft_consensus.cc:504] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.765646 20873 leader_election.cc:288] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15 [CANDIDATE]: Term 1 election: Requested vote from peers c6e9c56ffbd74798bcd294b8bed04c7b (127.10.189.193:36689), c8e4566a076444e3af4c37efe616fb03 (127.10.189.195:36829)
I20260806 15:56:36.765980 21006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2240136eb8549d4a227393cdae6ccc0" candidate_uuid: "559a99d65dfa41c7a118f5f7b5378b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c8e4566a076444e3af4c37efe616fb03"
I20260806 15:56:36.766006 20738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2240136eb8549d4a227393cdae6ccc0" candidate_uuid: "559a99d65dfa41c7a118f5f7b5378b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b"
I20260806 15:56:36.766141 21006 raft_consensus.cc:3037] T c2240136eb8549d4a227393cdae6ccc0 P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.766158 20738 raft_consensus.cc:3037] T c2240136eb8549d4a227393cdae6ccc0 P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.767113 20738 raft_consensus.cc:2454] T c2240136eb8549d4a227393cdae6ccc0 P c6e9c56ffbd74798bcd294b8bed04c7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 559a99d65dfa41c7a118f5f7b5378b15 in term 1.
I20260806 15:56:36.767109 21006 raft_consensus.cc:2454] T c2240136eb8549d4a227393cdae6ccc0 P c8e4566a076444e3af4c37efe616fb03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 559a99d65dfa41c7a118f5f7b5378b15 in term 1.
I20260806 15:56:36.767411 20804 leader_election.cc:302] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 559a99d65dfa41c7a118f5f7b5378b15, c8e4566a076444e3af4c37efe616fb03; no voters:
I20260806 15:56:36.767642 21083 raft_consensus.cc:2781] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:36.767757 21083 raft_consensus.cc:686] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Becoming Leader. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Running, Role: LEADER
I20260806 15:56:36.767904 21083 consensus_queue.cc:237] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.769555 20591 catalog_manager.cc:5495] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15 reported cstate change: term changed from 0 to 1, leader changed from <none> to 559a99d65dfa41c7a118f5f7b5378b15 (127.10.189.194). New cstate: current_term: 1 leader_uuid: "559a99d65dfa41c7a118f5f7b5378b15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } health_report { overall_health: UNKNOWN } } }
I20260806 15:56:36.774590 20873 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f1fa7492a9b94f90b0dab521783b52bd"
dest_uuid: "559a99d65dfa41c7a118f5f7b5378b15"
from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.774689 20873 raft_consensus.cc:482] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:36.774765 20873 raft_consensus.cc:3037] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.775514 20873 raft_consensus.cc:504] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.775815 20873 leader_election.cc:288] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15 [CANDIDATE]: Term 1 election: Requested vote from peers c6e9c56ffbd74798bcd294b8bed04c7b (127.10.189.193:36689), c8e4566a076444e3af4c37efe616fb03 (127.10.189.195:36829)
I20260806 15:56:36.776144 21006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1fa7492a9b94f90b0dab521783b52bd" candidate_uuid: "559a99d65dfa41c7a118f5f7b5378b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c8e4566a076444e3af4c37efe616fb03"
I20260806 15:56:36.776283 21006 raft_consensus.cc:3037] T f1fa7492a9b94f90b0dab521783b52bd P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.777135 21006 raft_consensus.cc:2454] T f1fa7492a9b94f90b0dab521783b52bd P c8e4566a076444e3af4c37efe616fb03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 559a99d65dfa41c7a118f5f7b5378b15 in term 1.
I20260806 15:56:36.777384 20738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1fa7492a9b94f90b0dab521783b52bd" candidate_uuid: "559a99d65dfa41c7a118f5f7b5378b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b"
I20260806 15:56:36.777405 20804 leader_election.cc:302] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 559a99d65dfa41c7a118f5f7b5378b15, c8e4566a076444e3af4c37efe616fb03; no voters:
I20260806 15:56:36.777504 20738 raft_consensus.cc:3037] T f1fa7492a9b94f90b0dab521783b52bd P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.777597 21083 raft_consensus.cc:2781] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:36.777673 21083 raft_consensus.cc:686] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Becoming Leader. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Running, Role: LEADER
I20260806 15:56:36.777782 21083 consensus_queue.cc:237] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.778481 20738 raft_consensus.cc:2454] T f1fa7492a9b94f90b0dab521783b52bd P c6e9c56ffbd74798bcd294b8bed04c7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 559a99d65dfa41c7a118f5f7b5378b15 in term 1.
I20260806 15:56:36.779377 20591 catalog_manager.cc:5495] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15 reported cstate change: term changed from 0 to 1, leader changed from <none> to 559a99d65dfa41c7a118f5f7b5378b15 (127.10.189.194). New cstate: current_term: 1 leader_uuid: "559a99d65dfa41c7a118f5f7b5378b15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } health_report { overall_health: UNKNOWN } } }
I20260806 15:56:36.784605 20873 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ad396afd73ed44c99daa347b0eb0a792"
dest_uuid: "559a99d65dfa41c7a118f5f7b5378b15"
from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.784703 20873 raft_consensus.cc:482] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:36.784775 20873 raft_consensus.cc:3037] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.785509 20873 raft_consensus.cc:504] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } } peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } }
I20260806 15:56:36.785843 20873 leader_election.cc:288] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15 [CANDIDATE]: Term 1 election: Requested vote from peers c8e4566a076444e3af4c37efe616fb03 (127.10.189.195:36829), c6e9c56ffbd74798bcd294b8bed04c7b (127.10.189.193:36689)
I20260806 15:56:36.786182 21006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad396afd73ed44c99daa347b0eb0a792" candidate_uuid: "559a99d65dfa41c7a118f5f7b5378b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c8e4566a076444e3af4c37efe616fb03"
I20260806 15:56:36.786305 21006 raft_consensus.cc:3037] T ad396afd73ed44c99daa347b0eb0a792 P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.786298 20738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad396afd73ed44c99daa347b0eb0a792" candidate_uuid: "559a99d65dfa41c7a118f5f7b5378b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b"
I20260806 15:56:36.786423 20738 raft_consensus.cc:3037] T ad396afd73ed44c99daa347b0eb0a792 P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.787241 21006 raft_consensus.cc:2454] T ad396afd73ed44c99daa347b0eb0a792 P c8e4566a076444e3af4c37efe616fb03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 559a99d65dfa41c7a118f5f7b5378b15 in term 1.
I20260806 15:56:36.787380 20738 raft_consensus.cc:2454] T ad396afd73ed44c99daa347b0eb0a792 P c6e9c56ffbd74798bcd294b8bed04c7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 559a99d65dfa41c7a118f5f7b5378b15 in term 1.
I20260806 15:56:36.787535 20804 leader_election.cc:302] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 559a99d65dfa41c7a118f5f7b5378b15, c8e4566a076444e3af4c37efe616fb03; no voters:
I20260806 15:56:36.787701 21083 raft_consensus.cc:2781] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:36.787825 21083 raft_consensus.cc:686] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Becoming Leader. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Running, Role: LEADER
I20260806 15:56:36.787990 21083 consensus_queue.cc:237] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } } peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } }
I20260806 15:56:36.789531 20591 catalog_manager.cc:5495] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15 reported cstate change: term changed from 0 to 1, leader changed from <none> to 559a99d65dfa41c7a118f5f7b5378b15 (127.10.189.194). New cstate: current_term: 1 leader_uuid: "559a99d65dfa41c7a118f5f7b5378b15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } health_report { overall_health: UNKNOWN } } }
I20260806 15:56:36.794521 20873 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "67b1065bf6494d17931f0c1cd042c5e3"
dest_uuid: "559a99d65dfa41c7a118f5f7b5378b15"
from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.794620 20873 raft_consensus.cc:482] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:36.794697 20873 raft_consensus.cc:3037] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.795425 20873 raft_consensus.cc:504] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.795756 20873 leader_election.cc:288] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15 [CANDIDATE]: Term 1 election: Requested vote from peers c6e9c56ffbd74798bcd294b8bed04c7b (127.10.189.193:36689), c8e4566a076444e3af4c37efe616fb03 (127.10.189.195:36829)
I20260806 15:56:36.796077 20738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67b1065bf6494d17931f0c1cd042c5e3" candidate_uuid: "559a99d65dfa41c7a118f5f7b5378b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b"
I20260806 15:56:36.796134 21006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67b1065bf6494d17931f0c1cd042c5e3" candidate_uuid: "559a99d65dfa41c7a118f5f7b5378b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c8e4566a076444e3af4c37efe616fb03"
I20260806 15:56:36.796252 21006 raft_consensus.cc:3037] T 67b1065bf6494d17931f0c1cd042c5e3 P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.796260 20738 raft_consensus.cc:3037] T 67b1065bf6494d17931f0c1cd042c5e3 P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.797219 21006 raft_consensus.cc:2454] T 67b1065bf6494d17931f0c1cd042c5e3 P c8e4566a076444e3af4c37efe616fb03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 559a99d65dfa41c7a118f5f7b5378b15 in term 1.
I20260806 15:56:36.797219 20738 raft_consensus.cc:2454] T 67b1065bf6494d17931f0c1cd042c5e3 P c6e9c56ffbd74798bcd294b8bed04c7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 559a99d65dfa41c7a118f5f7b5378b15 in term 1.
I20260806 15:56:36.797557 20802 leader_election.cc:302] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 559a99d65dfa41c7a118f5f7b5378b15, c6e9c56ffbd74798bcd294b8bed04c7b; no voters:
I20260806 15:56:36.797760 21083 raft_consensus.cc:2781] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:36.797855 21083 raft_consensus.cc:686] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Becoming Leader. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Running, Role: LEADER
I20260806 15:56:36.797991 21083 consensus_queue.cc:237] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.799676 20591 catalog_manager.cc:5495] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15 reported cstate change: term changed from 0 to 1, leader changed from <none> to 559a99d65dfa41c7a118f5f7b5378b15 (127.10.189.194). New cstate: current_term: 1 leader_uuid: "559a99d65dfa41c7a118f5f7b5378b15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } health_report { overall_health: UNKNOWN } } }
I20260806 15:56:36.805447 20873 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e87be408a193451bb0790b78805f074e"
dest_uuid: "559a99d65dfa41c7a118f5f7b5378b15"
from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.805545 20873 raft_consensus.cc:482] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:36.805624 20873 raft_consensus.cc:3037] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.806422 20873 raft_consensus.cc:504] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.806726 20873 leader_election.cc:288] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15 [CANDIDATE]: Term 1 election: Requested vote from peers c6e9c56ffbd74798bcd294b8bed04c7b (127.10.189.193:36689), c8e4566a076444e3af4c37efe616fb03 (127.10.189.195:36829)
I20260806 15:56:36.807037 20738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e87be408a193451bb0790b78805f074e" candidate_uuid: "559a99d65dfa41c7a118f5f7b5378b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b"
I20260806 15:56:36.807090 21006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e87be408a193451bb0790b78805f074e" candidate_uuid: "559a99d65dfa41c7a118f5f7b5378b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c8e4566a076444e3af4c37efe616fb03"
I20260806 15:56:36.807158 20738 raft_consensus.cc:3037] T e87be408a193451bb0790b78805f074e P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.807229 21006 raft_consensus.cc:3037] T e87be408a193451bb0790b78805f074e P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.808059 20738 raft_consensus.cc:2454] T e87be408a193451bb0790b78805f074e P c6e9c56ffbd74798bcd294b8bed04c7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 559a99d65dfa41c7a118f5f7b5378b15 in term 1.
I20260806 15:56:36.808128 21006 raft_consensus.cc:2454] T e87be408a193451bb0790b78805f074e P c8e4566a076444e3af4c37efe616fb03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 559a99d65dfa41c7a118f5f7b5378b15 in term 1.
I20260806 15:56:36.808364 20802 leader_election.cc:302] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 559a99d65dfa41c7a118f5f7b5378b15, c6e9c56ffbd74798bcd294b8bed04c7b; no voters:
I20260806 15:56:36.808512 21083 raft_consensus.cc:2781] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:36.808616 21083 raft_consensus.cc:686] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Becoming Leader. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Running, Role: LEADER
I20260806 15:56:36.808748 21083 consensus_queue.cc:237] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.810421 20591 catalog_manager.cc:5495] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15 reported cstate change: term changed from 0 to 1, leader changed from <none> to 559a99d65dfa41c7a118f5f7b5378b15 (127.10.189.194). New cstate: current_term: 1 leader_uuid: "559a99d65dfa41c7a118f5f7b5378b15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } health_report { overall_health: UNKNOWN } } }
I20260806 15:56:36.815433 20873 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "aa3973abeecb472193b52e51f1044630"
dest_uuid: "559a99d65dfa41c7a118f5f7b5378b15"
from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.815546 20873 raft_consensus.cc:482] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:36.815595 20873 raft_consensus.cc:3037] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.816290 20873 raft_consensus.cc:504] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.816613 20873 leader_election.cc:288] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15 [CANDIDATE]: Term 1 election: Requested vote from peers c6e9c56ffbd74798bcd294b8bed04c7b (127.10.189.193:36689), c8e4566a076444e3af4c37efe616fb03 (127.10.189.195:36829)
I20260806 15:56:36.816946 20738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa3973abeecb472193b52e51f1044630" candidate_uuid: "559a99d65dfa41c7a118f5f7b5378b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b"
I20260806 15:56:36.817101 20738 raft_consensus.cc:3037] T aa3973abeecb472193b52e51f1044630 P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.818109 20738 raft_consensus.cc:2454] T aa3973abeecb472193b52e51f1044630 P c6e9c56ffbd74798bcd294b8bed04c7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 559a99d65dfa41c7a118f5f7b5378b15 in term 1.
I20260806 15:56:36.818257 21006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa3973abeecb472193b52e51f1044630" candidate_uuid: "559a99d65dfa41c7a118f5f7b5378b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c8e4566a076444e3af4c37efe616fb03"
I20260806 15:56:36.818397 21006 raft_consensus.cc:3037] T aa3973abeecb472193b52e51f1044630 P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.818406 20802 leader_election.cc:302] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 559a99d65dfa41c7a118f5f7b5378b15, c6e9c56ffbd74798bcd294b8bed04c7b; no voters:
I20260806 15:56:36.818576 21083 raft_consensus.cc:2781] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:36.818671 21083 raft_consensus.cc:686] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Becoming Leader. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Running, Role: LEADER
I20260806 15:56:36.818786 21083 consensus_queue.cc:237] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.819375 21006 raft_consensus.cc:2454] T aa3973abeecb472193b52e51f1044630 P c8e4566a076444e3af4c37efe616fb03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 559a99d65dfa41c7a118f5f7b5378b15 in term 1.
W20260806 15:56:36.820358 21055 tablet.cc:2369] T 1476e13140e04607b41f18bfe2f9c9a0 P c8e4566a076444e3af4c37efe616fb03: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:56:36.820720 20591 catalog_manager.cc:5495] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15 reported cstate change: term changed from 0 to 1, leader changed from <none> to 559a99d65dfa41c7a118f5f7b5378b15 (127.10.189.194). New cstate: current_term: 1 leader_uuid: "559a99d65dfa41c7a118f5f7b5378b15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } health_report { overall_health: UNKNOWN } } }
I20260806 15:56:36.825325 20873 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "83e6a9d74d22469ebe49f3b9322e438a"
dest_uuid: "559a99d65dfa41c7a118f5f7b5378b15"
from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.825428 20873 raft_consensus.cc:482] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:36.825526 20873 raft_consensus.cc:3037] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.827064 20873 raft_consensus.cc:504] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.827462 20873 leader_election.cc:288] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15 [CANDIDATE]: Term 1 election: Requested vote from peers c6e9c56ffbd74798bcd294b8bed04c7b (127.10.189.193:36689), c8e4566a076444e3af4c37efe616fb03 (127.10.189.195:36829)
I20260806 15:56:36.827865 21006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83e6a9d74d22469ebe49f3b9322e438a" candidate_uuid: "559a99d65dfa41c7a118f5f7b5378b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c8e4566a076444e3af4c37efe616fb03"
I20260806 15:56:36.828006 21006 raft_consensus.cc:3037] T 83e6a9d74d22469ebe49f3b9322e438a P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.827873 20738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83e6a9d74d22469ebe49f3b9322e438a" candidate_uuid: "559a99d65dfa41c7a118f5f7b5378b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b"
I20260806 15:56:36.828219 20738 raft_consensus.cc:3037] T 83e6a9d74d22469ebe49f3b9322e438a P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.828922 21006 raft_consensus.cc:2454] T 83e6a9d74d22469ebe49f3b9322e438a P c8e4566a076444e3af4c37efe616fb03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 559a99d65dfa41c7a118f5f7b5378b15 in term 1.
I20260806 15:56:36.829171 20804 leader_election.cc:302] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 559a99d65dfa41c7a118f5f7b5378b15, c8e4566a076444e3af4c37efe616fb03; no voters:
I20260806 15:56:36.829272 20738 raft_consensus.cc:2454] T 83e6a9d74d22469ebe49f3b9322e438a P c6e9c56ffbd74798bcd294b8bed04c7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 559a99d65dfa41c7a118f5f7b5378b15 in term 1.
I20260806 15:56:36.829329 21086 raft_consensus.cc:2781] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:36.829416 21086 raft_consensus.cc:686] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Becoming Leader. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Running, Role: LEADER
I20260806 15:56:36.829552 21086 consensus_queue.cc:237] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.831212 20591 catalog_manager.cc:5495] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15 reported cstate change: term changed from 0 to 1, leader changed from <none> to 559a99d65dfa41c7a118f5f7b5378b15 (127.10.189.194). New cstate: current_term: 1 leader_uuid: "559a99d65dfa41c7a118f5f7b5378b15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } health_report { overall_health: UNKNOWN } } }
I20260806 15:56:36.837637 20873 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d276369bb8c74da8aa006d3ed75c15d3"
dest_uuid: "559a99d65dfa41c7a118f5f7b5378b15"
from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.837775 20873 raft_consensus.cc:482] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:36.837872 20873 raft_consensus.cc:3037] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.838708 20873 raft_consensus.cc:504] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.839032 20873 leader_election.cc:288] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15 [CANDIDATE]: Term 1 election: Requested vote from peers c6e9c56ffbd74798bcd294b8bed04c7b (127.10.189.193:36689), c8e4566a076444e3af4c37efe616fb03 (127.10.189.195:36829)
I20260806 15:56:36.839375 20738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d276369bb8c74da8aa006d3ed75c15d3" candidate_uuid: "559a99d65dfa41c7a118f5f7b5378b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b"
I20260806 15:56:36.839524 20738 raft_consensus.cc:3037] T d276369bb8c74da8aa006d3ed75c15d3 P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.839502 21006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d276369bb8c74da8aa006d3ed75c15d3" candidate_uuid: "559a99d65dfa41c7a118f5f7b5378b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c8e4566a076444e3af4c37efe616fb03"
I20260806 15:56:36.839628 21006 raft_consensus.cc:3037] T d276369bb8c74da8aa006d3ed75c15d3 P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.840519 20738 raft_consensus.cc:2454] T d276369bb8c74da8aa006d3ed75c15d3 P c6e9c56ffbd74798bcd294b8bed04c7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 559a99d65dfa41c7a118f5f7b5378b15 in term 1.
I20260806 15:56:36.840547 21006 raft_consensus.cc:2454] T d276369bb8c74da8aa006d3ed75c15d3 P c8e4566a076444e3af4c37efe616fb03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 559a99d65dfa41c7a118f5f7b5378b15 in term 1.
I20260806 15:56:36.840802 20802 leader_election.cc:302] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 559a99d65dfa41c7a118f5f7b5378b15, c6e9c56ffbd74798bcd294b8bed04c7b; no voters:
I20260806 15:56:36.840971 21086 raft_consensus.cc:2781] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:36.841089 21086 raft_consensus.cc:686] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Becoming Leader. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Running, Role: LEADER
I20260806 15:56:36.841218 21086 consensus_queue.cc:237] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.843031 20591 catalog_manager.cc:5495] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15 reported cstate change: term changed from 0 to 1, leader changed from <none> to 559a99d65dfa41c7a118f5f7b5378b15 (127.10.189.194). New cstate: current_term: 1 leader_uuid: "559a99d65dfa41c7a118f5f7b5378b15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } health_report { overall_health: UNKNOWN } } }
I20260806 15:56:36.848064 20873 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "dd7e736f37cd410196d67e04dec4a1b9"
dest_uuid: "559a99d65dfa41c7a118f5f7b5378b15"
from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.848225 20873 raft_consensus.cc:482] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:56:36.848304 20873 raft_consensus.cc:3037] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.852653 20873 raft_consensus.cc:504] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.853082 20873 leader_election.cc:288] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15 [CANDIDATE]: Term 1 election: Requested vote from peers c6e9c56ffbd74798bcd294b8bed04c7b (127.10.189.193:36689), c8e4566a076444e3af4c37efe616fb03 (127.10.189.195:36829)
I20260806 15:56:36.853415 20738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd7e736f37cd410196d67e04dec4a1b9" candidate_uuid: "559a99d65dfa41c7a118f5f7b5378b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b"
I20260806 15:56:36.853462 21006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd7e736f37cd410196d67e04dec4a1b9" candidate_uuid: "559a99d65dfa41c7a118f5f7b5378b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c8e4566a076444e3af4c37efe616fb03"
I20260806 15:56:36.853566 21006 raft_consensus.cc:3037] T dd7e736f37cd410196d67e04dec4a1b9 P c8e4566a076444e3af4c37efe616fb03 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.853559 20738 raft_consensus.cc:3037] T dd7e736f37cd410196d67e04dec4a1b9 P c6e9c56ffbd74798bcd294b8bed04c7b [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:56:36.854553 20738 raft_consensus.cc:2454] T dd7e736f37cd410196d67e04dec4a1b9 P c6e9c56ffbd74798bcd294b8bed04c7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 559a99d65dfa41c7a118f5f7b5378b15 in term 1.
I20260806 15:56:36.854552 21006 raft_consensus.cc:2454] T dd7e736f37cd410196d67e04dec4a1b9 P c8e4566a076444e3af4c37efe616fb03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 559a99d65dfa41c7a118f5f7b5378b15 in term 1.
I20260806 15:56:36.854846 20804 leader_election.cc:302] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 559a99d65dfa41c7a118f5f7b5378b15, c8e4566a076444e3af4c37efe616fb03; no voters:
I20260806 15:56:36.855023 21086 raft_consensus.cc:2781] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:56:36.855120 21086 raft_consensus.cc:686] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Becoming Leader. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Running, Role: LEADER
I20260806 15:56:36.855268 21086 consensus_queue.cc:237] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.857028 20591 catalog_manager.cc:5495] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15 reported cstate change: term changed from 0 to 1, leader changed from <none> to 559a99d65dfa41c7a118f5f7b5378b15 (127.10.189.194). New cstate: current_term: 1 leader_uuid: "559a99d65dfa41c7a118f5f7b5378b15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } health_report { overall_health: UNKNOWN } } }
I20260806 15:56:36.862238 20844 tablet_service.cc:1514] Processing DeleteTablet for tablet 1476e13140e04607b41f18bfe2f9c9a0 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.862661 21128 tablet_replica.cc:330] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15: stopping tablet replica
I20260806 15:56:36.863029 21128 raft_consensus.cc:2229] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:56:36.863363 21128 pending_rounds.cc:62] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15: Trying to abort 1 pending ops.
I20260806 15:56:36.863472 21128 pending_rounds.cc:68] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315586239514275840 op_type: NO_OP noop_request { }
I20260806 15:56:36.863592 21128 raft_consensus.cc:2866] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260806 15:56:36.863683 21128 raft_consensus.cc:2258] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260806 15:56:36.864667 20920 tablet.cc:2369] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:56:36.865002 21128 ts_tablet_manager.cc:1905] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260806 15:56:36.867066 21128 ts_tablet_manager.cc:1918] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260806 15:56:36.867151 21128 log.cc:1196] T 1476e13140e04607b41f18bfe2f9c9a0 P 559a99d65dfa41c7a118f5f7b5378b15: Deleting WAL directory at /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/wals/1476e13140e04607b41f18bfe2f9c9a0
I20260806 15:56:36.872833 20844 tablet_service.cc:1514] Processing DeleteTablet for tablet c2240136eb8549d4a227393cdae6ccc0 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.873018 21128 tablet_replica.cc:330] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15: stopping tablet replica
I20260806 15:56:36.873126 21128 raft_consensus.cc:2229] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:56:36.873238 21128 pending_rounds.cc:62] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15: Trying to abort 1 pending ops.
I20260806 15:56:36.873265 21128 pending_rounds.cc:68] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315586239562706944 op_type: NO_OP noop_request { }
I20260806 15:56:36.873317 21128 raft_consensus.cc:2866] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260806 15:56:36.873356 21128 raft_consensus.cc:2258] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:56:36.873864 21128 ts_tablet_manager.cc:1905] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260806 15:56:36.875551 21128 ts_tablet_manager.cc:1918] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260806 15:56:36.875617 21128 log.cc:1196] T c2240136eb8549d4a227393cdae6ccc0 P 559a99d65dfa41c7a118f5f7b5378b15: Deleting WAL directory at /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/wals/c2240136eb8549d4a227393cdae6ccc0
I20260806 15:56:36.881655 20844 tablet_service.cc:1514] Processing DeleteTablet for tablet f1fa7492a9b94f90b0dab521783b52bd with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.881870 21128 tablet_replica.cc:330] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15: stopping tablet replica
I20260806 15:56:36.881983 21128 raft_consensus.cc:2229] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:56:36.882198 21128 pending_rounds.cc:62] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15: Trying to abort 1 pending ops.
I20260806 15:56:36.882233 21128 pending_rounds.cc:68] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315586239602937856 op_type: NO_OP noop_request { }
I20260806 15:56:36.882298 21128 raft_consensus.cc:2866] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260806 15:56:36.882342 21128 raft_consensus.cc:2258] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:56:36.882890 21128 ts_tablet_manager.cc:1905] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260806 15:56:36.884533 21128 ts_tablet_manager.cc:1918] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260806 15:56:36.884598 21128 log.cc:1196] T f1fa7492a9b94f90b0dab521783b52bd P 559a99d65dfa41c7a118f5f7b5378b15: Deleting WAL directory at /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/wals/f1fa7492a9b94f90b0dab521783b52bd
I20260806 15:56:36.890436 20844 tablet_service.cc:1514] Processing DeleteTablet for tablet ad396afd73ed44c99daa347b0eb0a792 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.890619 21128 tablet_replica.cc:330] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15: stopping tablet replica
I20260806 15:56:36.890725 21128 raft_consensus.cc:2229] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:56:36.890843 21128 pending_rounds.cc:62] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15: Trying to abort 1 pending ops.
I20260806 15:56:36.890867 21128 pending_rounds.cc:68] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315586239644946432 op_type: NO_OP noop_request { }
I20260806 15:56:36.890921 21128 raft_consensus.cc:2866] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260806 15:56:36.890969 21128 raft_consensus.cc:2258] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:56:36.891563 21128 ts_tablet_manager.cc:1905] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260806 15:56:36.893276 21128 ts_tablet_manager.cc:1918] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260806 15:56:36.893349 21128 log.cc:1196] T ad396afd73ed44c99daa347b0eb0a792 P 559a99d65dfa41c7a118f5f7b5378b15: Deleting WAL directory at /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/wals/ad396afd73ed44c99daa347b0eb0a792
I20260806 15:56:36.900108 20844 tablet_service.cc:1514] Processing DeleteTablet for tablet 67b1065bf6494d17931f0c1cd042c5e3 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.900291 21128 tablet_replica.cc:330] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15: stopping tablet replica
I20260806 15:56:36.900386 21128 raft_consensus.cc:2229] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:56:36.900506 21128 pending_rounds.cc:62] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15: Trying to abort 1 pending ops.
I20260806 15:56:36.900532 21128 pending_rounds.cc:68] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315586239686098944 op_type: NO_OP noop_request { }
I20260806 15:56:36.900586 21128 raft_consensus.cc:2866] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260806 15:56:36.900627 21128 raft_consensus.cc:2258] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:56:36.901227 21128 ts_tablet_manager.cc:1905] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260806 15:56:36.902884 21128 ts_tablet_manager.cc:1918] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260806 15:56:36.902957 21128 log.cc:1196] T 67b1065bf6494d17931f0c1cd042c5e3 P 559a99d65dfa41c7a118f5f7b5378b15: Deleting WAL directory at /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/wals/67b1065bf6494d17931f0c1cd042c5e3
I20260806 15:56:36.908718 20873 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e87be408a193451bb0790b78805f074e"
dest_uuid: "559a99d65dfa41c7a118f5f7b5378b15"
from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.908874 20873 raft_consensus.cc:580] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Received request to step down
I20260806 15:56:36.908914 20873 raft_consensus.cc:3032] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Stepping down as leader of term 1
I20260806 15:56:36.908936 20873 raft_consensus.cc:729] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Running, Role: LEADER
I20260806 15:56:36.909063 20873 consensus_queue.cc:260] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.909179 20873 raft_consensus.cc:3037] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:36.914958 20844 tablet_service.cc:1514] Processing DeleteTablet for tablet e87be408a193451bb0790b78805f074e with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.915153 21128 tablet_replica.cc:330] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15: stopping tablet replica
I20260806 15:56:36.915263 21128 raft_consensus.cc:2229] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260806 15:56:36.915349 21128 pending_rounds.cc:62] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15: Trying to abort 1 pending ops.
I20260806 15:56:36.915371 21128 pending_rounds.cc:68] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315586239729786880 op_type: NO_OP noop_request { }
I20260806 15:56:36.915427 21128 raft_consensus.cc:2866] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260806 15:56:36.915481 21128 raft_consensus.cc:2258] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260806 15:56:36.916052 21128 ts_tablet_manager.cc:1905] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260806 15:56:36.917861 21128 ts_tablet_manager.cc:1918] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260806 15:56:36.917959 21128 log.cc:1196] T e87be408a193451bb0790b78805f074e P 559a99d65dfa41c7a118f5f7b5378b15: Deleting WAL directory at /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/wals/e87be408a193451bb0790b78805f074e
I20260806 15:56:36.923754 20873 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "aa3973abeecb472193b52e51f1044630"
dest_uuid: "559a99d65dfa41c7a118f5f7b5378b15"
from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.923882 20873 raft_consensus.cc:580] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Received request to step down
I20260806 15:56:36.923919 20873 raft_consensus.cc:3032] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Stepping down as leader of term 1
I20260806 15:56:36.923964 20873 raft_consensus.cc:729] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Running, Role: LEADER
I20260806 15:56:36.924060 20873 consensus_queue.cc:260] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.924171 20873 raft_consensus.cc:3037] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:36.930303 20844 tablet_service.cc:1514] Processing DeleteTablet for tablet aa3973abeecb472193b52e51f1044630 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.930501 21128 tablet_replica.cc:330] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15: stopping tablet replica
I20260806 15:56:36.930644 21128 raft_consensus.cc:2229] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260806 15:56:36.930749 21128 pending_rounds.cc:62] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15: Trying to abort 1 pending ops.
I20260806 15:56:36.930780 21128 pending_rounds.cc:68] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315586239771017216 op_type: NO_OP noop_request { }
I20260806 15:56:36.930858 21128 raft_consensus.cc:2866] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260806 15:56:36.930917 21128 raft_consensus.cc:2258] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260806 15:56:36.931604 21128 ts_tablet_manager.cc:1905] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260806 15:56:36.933701 21128 ts_tablet_manager.cc:1918] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260806 15:56:36.933764 21128 log.cc:1196] T aa3973abeecb472193b52e51f1044630 P 559a99d65dfa41c7a118f5f7b5378b15: Deleting WAL directory at /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/wals/aa3973abeecb472193b52e51f1044630
I20260806 15:56:36.939881 20873 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "83e6a9d74d22469ebe49f3b9322e438a"
dest_uuid: "559a99d65dfa41c7a118f5f7b5378b15"
from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.940060 20873 raft_consensus.cc:580] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Received request to step down
I20260806 15:56:36.940128 20873 raft_consensus.cc:3032] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Stepping down as leader of term 1
I20260806 15:56:36.940169 20873 raft_consensus.cc:729] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Running, Role: LEADER
I20260806 15:56:36.940296 20873 consensus_queue.cc:260] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.940470 20873 raft_consensus.cc:3037] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:36.948372 20844 tablet_service.cc:1514] Processing DeleteTablet for tablet 83e6a9d74d22469ebe49f3b9322e438a with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.948637 21128 tablet_replica.cc:330] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15: stopping tablet replica
I20260806 15:56:36.948783 21128 raft_consensus.cc:2229] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260806 15:56:36.948917 21128 pending_rounds.cc:62] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15: Trying to abort 1 pending ops.
I20260806 15:56:36.948951 21128 pending_rounds.cc:68] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315586239815114752 op_type: NO_OP noop_request { }
I20260806 15:56:36.949038 21128 raft_consensus.cc:2866] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260806 15:56:36.949101 21128 raft_consensus.cc:2258] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260806 15:56:36.949819 21128 ts_tablet_manager.cc:1905] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260806 15:56:36.951880 21128 ts_tablet_manager.cc:1918] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260806 15:56:36.952005 21128 log.cc:1196] T 83e6a9d74d22469ebe49f3b9322e438a P 559a99d65dfa41c7a118f5f7b5378b15: Deleting WAL directory at /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/wals/83e6a9d74d22469ebe49f3b9322e438a
I20260806 15:56:36.958578 20873 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d276369bb8c74da8aa006d3ed75c15d3"
dest_uuid: "559a99d65dfa41c7a118f5f7b5378b15"
from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.958742 20873 raft_consensus.cc:580] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Received request to step down
I20260806 15:56:36.958804 20873 raft_consensus.cc:3032] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Stepping down as leader of term 1
I20260806 15:56:36.958864 20873 raft_consensus.cc:729] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Running, Role: LEADER
I20260806 15:56:36.959010 20873 consensus_queue.cc:260] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.959167 20873 raft_consensus.cc:3037] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:36.965378 20844 tablet_service.cc:1514] Processing DeleteTablet for tablet d276369bb8c74da8aa006d3ed75c15d3 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.965629 21128 tablet_replica.cc:330] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15: stopping tablet replica
I20260806 15:56:36.965782 21128 raft_consensus.cc:2229] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260806 15:56:36.965974 21128 pending_rounds.cc:62] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15: Trying to abort 1 pending ops.
I20260806 15:56:36.966012 21128 pending_rounds.cc:68] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315586239863062528 op_type: NO_OP noop_request { }
I20260806 15:56:36.966135 21128 raft_consensus.cc:2866] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260806 15:56:36.966198 21128 raft_consensus.cc:2258] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260806 15:56:36.966830 21128 ts_tablet_manager.cc:1905] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260806 15:56:36.968902 21128 ts_tablet_manager.cc:1918] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260806 15:56:36.968978 21128 log.cc:1196] T d276369bb8c74da8aa006d3ed75c15d3 P 559a99d65dfa41c7a118f5f7b5378b15: Deleting WAL directory at /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/wals/d276369bb8c74da8aa006d3ed75c15d3
I20260806 15:56:36.975203 20873 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "dd7e736f37cd410196d67e04dec4a1b9"
dest_uuid: "559a99d65dfa41c7a118f5f7b5378b15"
from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.975375 20873 raft_consensus.cc:580] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Received request to step down
I20260806 15:56:36.975454 20873 raft_consensus.cc:3032] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Stepping down as leader of term 1
I20260806 15:56:36.975503 20873 raft_consensus.cc:729] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 559a99d65dfa41c7a118f5f7b5378b15, State: Running, Role: LEADER
I20260806 15:56:36.975651 20873 consensus_queue.cc:260] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e9c56ffbd74798bcd294b8bed04c7b" member_type: VOTER last_known_addr { host: "127.10.189.193" port: 36689 } } peers { permanent_uuid: "559a99d65dfa41c7a118f5f7b5378b15" member_type: VOTER last_known_addr { host: "127.10.189.194" port: 35147 } } peers { permanent_uuid: "c8e4566a076444e3af4c37efe616fb03" member_type: VOTER last_known_addr { host: "127.10.189.195" port: 36829 } }
I20260806 15:56:36.975800 20873 raft_consensus.cc:3037] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:56:36.981736 20844 tablet_service.cc:1514] Processing DeleteTablet for tablet dd7e736f37cd410196d67e04dec4a1b9 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:40210
I20260806 15:56:36.982018 21128 tablet_replica.cc:330] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15: stopping tablet replica
I20260806 15:56:36.982192 21128 raft_consensus.cc:2229] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260806 15:56:36.982321 21128 pending_rounds.cc:62] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15: Trying to abort 1 pending ops.
I20260806 15:56:36.982357 21128 pending_rounds.cc:68] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315586239920857088 op_type: NO_OP noop_request { }
I20260806 15:56:36.982450 21128 raft_consensus.cc:2866] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260806 15:56:36.982507 21128 raft_consensus.cc:2258] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260806 15:56:36.983168 21128 ts_tablet_manager.cc:1905] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260806 15:56:36.985185 21128 ts_tablet_manager.cc:1918] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260806 15:56:36.985255 21128 log.cc:1196] T dd7e736f37cd410196d67e04dec4a1b9 P 559a99d65dfa41c7a118f5f7b5378b15: Deleting WAL directory at /tmp/dist-test-taskSIF0T4/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786031626089658-10999-0/raft_consensus-itest-cluster/ts-1/wal/wals/dd7e736f37cd410196d67e04dec4a1b9
I20260806 15:56:36.991744 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 20654
I20260806 15:56:36.998865 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 20787
I20260806 15:56:37.005738 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 20922
I20260806 15:56:37.012599 10999 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskSIF0T4/build/debug/bin/kudu with pid 20559
2026-08-06T15:56:37Z chronyd exiting
[ OK ] NumReplicas/RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric/1 (1322 ms)
[----------] 2 tests from NumReplicas/RaftConsensusNumLeadersMetricTest (2143 ms total)
[----------] Global test environment tear-down
[==========] 14 tests from 2 test suites ran. (170896 ms total)
[ PASSED ] 13 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] RaftConsensusElectionITest.TestNewLeaderCantResolvePeers
1 FAILED TEST
I20260806 15:56:37.040081 10999 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/meta_cache.cc:302: suppressed but not reported on 9 messages since previous log ~10 seconds ago