Note: This is test shard 3 of 6.
[==========] Running 7 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from RaftConsensusITest
[ RUN ] RaftConsensusITest.TestFailedOp
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260925 14:49:57.886503 12675 test_util.cc:268] Using random seed: -729516536
I20260925 14:49:57.892307 12675 ts_itest-base.cc:112] Starting cluster with:
I20260925 14:49:57.892359 12675 ts_itest-base.cc:113] --------------
I20260925 14:49:57.892374 12675 ts_itest-base.cc:114] 3 tablet servers
I20260925 14:49:57.892397 12675 ts_itest-base.cc:115] 3 replicas per TS
I20260925 14:49:57.892411 12675 ts_itest-base.cc:116] --------------
2026-09-25T14:49:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-25T14:49:57Z Disabled control of system clock
I20260925 14:49:57.900014 12675 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKe2EOk/build/release/bin/kudu
/tmp/dist-test-taskKe2EOk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.96.254:35295
--webserver_interface=127.12.96.254
--webserver_port=0
--builtin_ntp_servers=127.12.96.212:45673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.96.254:35295 with env {}
W20260925 14:49:57.975052 12687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 14:49:57.975250 12687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 14:49:57.975267 12687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 14:49:57.976384 12687 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260925 14:49:57.976419 12687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 14:49:57.976431 12687 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260925 14:49:57.976444 12687 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260925 14:49:57.977734 12687 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.96.212:45673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.96.254:35295
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.96.254:35295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.12.96.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.12687
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 25 Sep 2026 13:57:57 UTC on ccycloud.quasar-zfbtwj.root.comops.site
build id 4672727
I20260925 14:49:57.977936 12687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 14:49:57.978221 12687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 14:49:57.982947 12695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 14:49:57.983040 12692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 14:49:57.982954 12687 server_base.cc:1034] running on GCE node
W20260925 14:49:57.982954 12693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 14:49:57.983392 12687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 14:49:57.983683 12687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 14:49:57.984819 12687 hybrid_clock.cc:648] HybridClock initialized: now 1790347797984803 us; error 32 us; skew 500 ppm
I20260925 14:49:57.989854 12687 webserver.cc:460] Webserver started at http://127.12.96.254:42447/ using document root <none> and password file <none>
I20260925 14:49:57.990047 12687 fs_manager.cc:359] Metadata directory not provided
I20260925 14:49:57.990093 12687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 14:49:57.990227 12687 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 14:49:57.991120 12687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "b260158d351a47b6a703877f0f131364"
format_stamp: "Formatted at 2026-09-25 14:49:57 on dist-test-slave-nsrc"
I20260925 14:49:57.991451 12687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "b260158d351a47b6a703877f0f131364"
format_stamp: "Formatted at 2026-09-25 14:49:57 on dist-test-slave-nsrc"
I20260925 14:49:57.992714 12687 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260925 14:49:57.993379 12701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 14:49:57.993515 12687 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260925 14:49:57.993599 12687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/wal
uuid: "b260158d351a47b6a703877f0f131364"
format_stamp: "Formatted at 2026-09-25 14:49:57 on dist-test-slave-nsrc"
I20260925 14:49:57.993659 12687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 14:49:58.005316 12687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 14:49:58.005538 12687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 14:49:58.005651 12687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 14:49:58.009145 12687 rpc_server.cc:307] RPC server started. Bound to: 127.12.96.254:35295
I20260925 14:49:58.009174 12753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.96.254:35295 every 8 connection(s)
I20260925 14:49:58.009440 12687 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260925 14:49:58.009996 12754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 14:49:58.012403 12754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364: Bootstrap starting.
I20260925 14:49:58.012912 12754 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364: Neither blocks nor log segments found. Creating new log.
I20260925 14:49:58.013167 12754 log.cc:824] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364: Log is configured to *not* fsync() on all Append() calls
I20260925 14:49:58.013561 12675 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKe2EOk/build/release/bin/kudu as pid 12687
I20260925 14:49:58.013664 12675 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260925 14:49:58.013921 12754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364: No bootstrap required, opened a new log
I20260925 14:49:58.015995 12754 raft_consensus.cc:348] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b260158d351a47b6a703877f0f131364" member_type: VOTER last_known_addr { host: "127.12.96.254" port: 35295 } }
I20260925 14:49:58.016206 12754 raft_consensus.cc:374] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 14:49:58.016258 12754 raft_consensus.cc:729] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b260158d351a47b6a703877f0f131364, State: Initialized, Role: FOLLOWER
I20260925 14:49:58.016376 12754 consensus_queue.cc:260] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b260158d351a47b6a703877f0f131364" member_type: VOTER last_known_addr { host: "127.12.96.254" port: 35295 } }
I20260925 14:49:58.016454 12754 raft_consensus.cc:388] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260925 14:49:58.016491 12754 raft_consensus.cc:482] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260925 14:49:58.016533 12754 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364 [term 0 FOLLOWER]: Advancing to term 1
I20260925 14:49:58.017095 12754 raft_consensus.cc:504] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b260158d351a47b6a703877f0f131364" member_type: VOTER last_known_addr { host: "127.12.96.254" port: 35295 } }
I20260925 14:49:58.017197 12754 leader_election.cc:302] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b260158d351a47b6a703877f0f131364; no voters:
I20260925 14:49:58.017345 12754 leader_election.cc:288] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260925 14:49:58.017371 12759 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 14:49:58.017536 12759 raft_consensus.cc:686] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364 [term 1 LEADER]: Becoming Leader. State: Replica: b260158d351a47b6a703877f0f131364, State: Running, Role: LEADER
I20260925 14:49:58.017565 12754 sys_catalog.cc:564] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364 [sys.catalog]: configured and running, proceeding with master startup.
I20260925 14:49:58.017623 12759 consensus_queue.cc:237] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b260158d351a47b6a703877f0f131364" member_type: VOTER last_known_addr { host: "127.12.96.254" port: 35295 } }
I20260925 14:49:58.017922 12759 sys_catalog.cc:455] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b260158d351a47b6a703877f0f131364. Latest consensus state: current_term: 1 leader_uuid: "b260158d351a47b6a703877f0f131364" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b260158d351a47b6a703877f0f131364" member_type: VOTER last_known_addr { host: "127.12.96.254" port: 35295 } } }
I20260925 14:49:58.017967 12760 sys_catalog.cc:455] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b260158d351a47b6a703877f0f131364" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b260158d351a47b6a703877f0f131364" member_type: VOTER last_known_addr { host: "127.12.96.254" port: 35295 } } }
I20260925 14:49:58.018111 12760 sys_catalog.cc:458] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364 [sys.catalog]: This master's current role is: LEADER
I20260925 14:49:58.018054 12759 sys_catalog.cc:458] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364 [sys.catalog]: This master's current role is: LEADER
I20260925 14:49:58.018507 12768 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260925 14:49:58.018985 12768 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260925 14:49:58.020599 12768 catalog_manager.cc:1347] Generated new cluster ID: 4e11be4fb18740858b282bac8c71a77c
I20260925 14:49:58.020651 12768 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260925 14:49:58.052103 12768 catalog_manager.cc:1370] Generated new certificate authority record
I20260925 14:49:58.052812 12768 catalog_manager.cc:1504] Loading token signing keys...
I20260925 14:49:58.056177 12768 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b260158d351a47b6a703877f0f131364: Generated new TSK 0
I20260925 14:49:58.056341 12768 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260925 14:49:58.062574 12675 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKe2EOk/build/release/bin/kudu
/tmp/dist-test-taskKe2EOk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.96.193:0
--local_ip_for_outbound_sockets=127.12.96.193
--webserver_interface=127.12.96.193
--webserver_port=0
--tserver_master_addrs=127.12.96.254:35295
--builtin_ntp_servers=127.12.96.212:45673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=50 with env {}
W20260925 14:49:58.156073 12778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 14:49:58.156302 12778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 14:49:58.156329 12778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 14:49:58.157470 12778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 14:49:58.157522 12778 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.96.193
I20260925 14:49:58.158811 12778 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.96.212:45673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=50
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.96.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.12.96.193
--webserver_port=0
--tserver_master_addrs=127.12.96.254:35295
--never_fsync=true
--heap_profile_path=/tmp/kudu.12778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.96.193
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 25 Sep 2026 13:57:57 UTC on ccycloud.quasar-zfbtwj.root.comops.site
build id 4672727
I20260925 14:49:58.159039 12778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 14:49:58.159304 12778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 14:49:58.164338 12786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 14:49:58.164337 12784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 14:49:58.164371 12783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 14:49:58.164593 12778 server_base.cc:1034] running on GCE node
I20260925 14:49:58.164880 12778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 14:49:58.165145 12778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 14:49:58.166316 12778 hybrid_clock.cc:648] HybridClock initialized: now 1790347798166303 us; error 33 us; skew 500 ppm
I20260925 14:49:58.167476 12778 webserver.cc:460] Webserver started at http://127.12.96.193:38897/ using document root <none> and password file <none>
I20260925 14:49:58.167695 12778 fs_manager.cc:359] Metadata directory not provided
I20260925 14:49:58.167742 12778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 14:49:58.167866 12778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 14:49:58.168861 12778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "37f8f0cb04964a5d82845ca1e389ca8b"
format_stamp: "Formatted at 2026-09-25 14:49:58 on dist-test-slave-nsrc"
I20260925 14:49:58.169173 12778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "37f8f0cb04964a5d82845ca1e389ca8b"
format_stamp: "Formatted at 2026-09-25 14:49:58 on dist-test-slave-nsrc"
I20260925 14:49:58.170317 12778 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260925 14:49:58.170900 12792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 14:49:58.171057 12778 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260925 14:49:58.171140 12778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "37f8f0cb04964a5d82845ca1e389ca8b"
format_stamp: "Formatted at 2026-09-25 14:49:58 on dist-test-slave-nsrc"
I20260925 14:49:58.171195 12778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 14:49:58.192569 12778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 14:49:58.192836 12778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 14:49:58.192955 12778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 14:49:58.193154 12778 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 14:49:58.193441 12778 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 14:49:58.193475 12778 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260925 14:49:58.193503 12778 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 14:49:58.193521 12778 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260925 14:49:58.199162 12778 rpc_server.cc:307] RPC server started. Bound to: 127.12.96.193:45563
I20260925 14:49:58.199204 12905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.96.193:45563 every 8 connection(s)
I20260925 14:49:58.199491 12778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260925 14:49:58.204406 12906 heartbeater.cc:347] Connected to a master server at 127.12.96.254:35295
I20260925 14:49:58.204494 12906 heartbeater.cc:464] Registering TS with master...
I20260925 14:49:58.204653 12906 heartbeater.cc:511] Master 127.12.96.254:35295 requested a full tablet report, sending...
I20260925 14:49:58.205132 12718 ts_manager.cc:194] Registered new tserver with Master: 37f8f0cb04964a5d82845ca1e389ca8b (127.12.96.193:45563)
I20260925 14:49:58.205706 12718 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.96.193:33551
I20260925 14:49:58.207888 12675 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKe2EOk/build/release/bin/kudu as pid 12778
I20260925 14:49:58.207957 12675 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260925 14:49:58.208842 12675 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKe2EOk/build/release/bin/kudu
/tmp/dist-test-taskKe2EOk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.96.194:0
--local_ip_for_outbound_sockets=127.12.96.194
--webserver_interface=127.12.96.194
--webserver_port=0
--tserver_master_addrs=127.12.96.254:35295
--builtin_ntp_servers=127.12.96.212:45673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=50 with env {}
W20260925 14:49:58.285918 12909 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 14:49:58.286113 12909 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 14:49:58.286130 12909 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 14:49:58.287230 12909 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 14:49:58.287281 12909 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.96.194
I20260925 14:49:58.288563 12909 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.96.212:45673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=50
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.96.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.12.96.194
--webserver_port=0
--tserver_master_addrs=127.12.96.254:35295
--never_fsync=true
--heap_profile_path=/tmp/kudu.12909
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.96.194
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 25 Sep 2026 13:57:57 UTC on ccycloud.quasar-zfbtwj.root.comops.site
build id 4672727
I20260925 14:49:58.288758 12909 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 14:49:58.289005 12909 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 14:49:58.293481 12917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 14:49:58.293547 12909 server_base.cc:1034] running on GCE node
W20260925 14:49:58.293496 12914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 14:49:58.293490 12915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 14:49:58.293885 12909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 14:49:58.294093 12909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 14:49:58.295224 12909 hybrid_clock.cc:648] HybridClock initialized: now 1790347798295209 us; error 30 us; skew 500 ppm
I20260925 14:49:58.296455 12909 webserver.cc:460] Webserver started at http://127.12.96.194:36149/ using document root <none> and password file <none>
I20260925 14:49:58.296669 12909 fs_manager.cc:359] Metadata directory not provided
I20260925 14:49:58.296715 12909 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 14:49:58.296838 12909 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 14:49:58.297763 12909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "2cd8fa8105174954b5d42c8a9b07f7b1"
format_stamp: "Formatted at 2026-09-25 14:49:58 on dist-test-slave-nsrc"
I20260925 14:49:58.298043 12909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "2cd8fa8105174954b5d42c8a9b07f7b1"
format_stamp: "Formatted at 2026-09-25 14:49:58 on dist-test-slave-nsrc"
I20260925 14:49:58.299122 12909 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260925 14:49:58.299681 12923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 14:49:58.299842 12909 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260925 14:49:58.299916 12909 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "2cd8fa8105174954b5d42c8a9b07f7b1"
format_stamp: "Formatted at 2026-09-25 14:49:58 on dist-test-slave-nsrc"
I20260925 14:49:58.299964 12909 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 14:49:58.315001 12909 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 14:49:58.315228 12909 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 14:49:58.315321 12909 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 14:49:58.315485 12909 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 14:49:58.315739 12909 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 14:49:58.315768 12909 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260925 14:49:58.315791 12909 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 14:49:58.315806 12909 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260925 14:49:58.321789 12909 rpc_server.cc:307] RPC server started. Bound to: 127.12.96.194:43179
I20260925 14:49:58.321851 13036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.96.194:43179 every 8 connection(s)
I20260925 14:49:58.322127 12909 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260925 14:49:58.322558 12675 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKe2EOk/build/release/bin/kudu as pid 12909
I20260925 14:49:58.322638 12675 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260925 14:49:58.323725 12675 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKe2EOk/build/release/bin/kudu
/tmp/dist-test-taskKe2EOk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.96.195:0
--local_ip_for_outbound_sockets=127.12.96.195
--webserver_interface=127.12.96.195
--webserver_port=0
--tserver_master_addrs=127.12.96.254:35295
--builtin_ntp_servers=127.12.96.212:45673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=50 with env {}
I20260925 14:49:58.328045 13037 heartbeater.cc:347] Connected to a master server at 127.12.96.254:35295
I20260925 14:49:58.328159 13037 heartbeater.cc:464] Registering TS with master...
I20260925 14:49:58.328346 13037 heartbeater.cc:511] Master 127.12.96.254:35295 requested a full tablet report, sending...
I20260925 14:49:58.328698 12718 ts_manager.cc:194] Registered new tserver with Master: 2cd8fa8105174954b5d42c8a9b07f7b1 (127.12.96.194:43179)
I20260925 14:49:58.329164 12718 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.96.194:45605
W20260925 14:49:58.403556 13040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 14:49:58.403777 13040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 14:49:58.403800 13040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 14:49:58.404902 13040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 14:49:58.404959 13040 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.96.195
I20260925 14:49:58.406179 13040 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.96.212:45673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=50
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.96.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.12.96.195
--webserver_port=0
--tserver_master_addrs=127.12.96.254:35295
--never_fsync=true
--heap_profile_path=/tmp/kudu.13040
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.96.195
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 25 Sep 2026 13:57:57 UTC on ccycloud.quasar-zfbtwj.root.comops.site
build id 4672727
I20260925 14:49:58.406359 13040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 14:49:58.406586 13040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 14:49:58.411096 13046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 14:49:58.411072 13045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 14:49:58.411078 13048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 14:49:58.411115 13040 server_base.cc:1034] running on GCE node
I20260925 14:49:58.411499 13040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 14:49:58.411725 13040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 14:49:58.412858 13040 hybrid_clock.cc:648] HybridClock initialized: now 1790347798412845 us; error 27 us; skew 500 ppm
I20260925 14:49:58.413972 13040 webserver.cc:460] Webserver started at http://127.12.96.195:42255/ using document root <none> and password file <none>
I20260925 14:49:58.414170 13040 fs_manager.cc:359] Metadata directory not provided
I20260925 14:49:58.414213 13040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 14:49:58.414332 13040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 14:49:58.415230 13040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "574f4a1c05a4462eb39a08bb52954a8e"
format_stamp: "Formatted at 2026-09-25 14:49:58 on dist-test-slave-nsrc"
I20260925 14:49:58.415570 13040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "574f4a1c05a4462eb39a08bb52954a8e"
format_stamp: "Formatted at 2026-09-25 14:49:58 on dist-test-slave-nsrc"
I20260925 14:49:58.416762 13040 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260925 14:49:58.417376 13054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 14:49:58.417546 13040 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260925 14:49:58.417624 13040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "574f4a1c05a4462eb39a08bb52954a8e"
format_stamp: "Formatted at 2026-09-25 14:49:58 on dist-test-slave-nsrc"
I20260925 14:49:58.417685 13040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 14:49:58.450613 13040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 14:49:58.450896 13040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 14:49:58.451022 13040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 14:49:58.451223 13040 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 14:49:58.451530 13040 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 14:49:58.451565 13040 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260925 14:49:58.451591 13040 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 14:49:58.451607 13040 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260925 14:49:58.457405 13040 rpc_server.cc:307] RPC server started. Bound to: 127.12.96.195:37445
I20260925 14:49:58.457473 13167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.96.195:37445 every 8 connection(s)
I20260925 14:49:58.457743 13040 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260925 14:49:58.458375 12675 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKe2EOk/build/release/bin/kudu as pid 13040
I20260925 14:49:58.458460 12675 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260925 14:49:58.462852 13168 heartbeater.cc:347] Connected to a master server at 127.12.96.254:35295
I20260925 14:49:58.462930 13168 heartbeater.cc:464] Registering TS with master...
I20260925 14:49:58.463061 13168 heartbeater.cc:511] Master 127.12.96.254:35295 requested a full tablet report, sending...
I20260925 14:49:58.463342 12718 ts_manager.cc:194] Registered new tserver with Master: 574f4a1c05a4462eb39a08bb52954a8e (127.12.96.195:37445)
I20260925 14:49:58.463666 12718 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.96.195:39985
I20260925 14:49:58.470247 12675 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260925 14:49:58.477094 12718 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48608:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
W20260925 14:49:58.478551 12718 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 14:49:58.484822 12971 tablet_service.cc:1467] Processing CreateTablet for tablet ca16be07404d4fa096bcff43bebef35f (DEFAULT_TABLE table=TestTable [id=c90777b6b27346f396ca6c0f05cc9cb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 14:49:58.484876 13102 tablet_service.cc:1467] Processing CreateTablet for tablet ca16be07404d4fa096bcff43bebef35f (DEFAULT_TABLE table=TestTable [id=c90777b6b27346f396ca6c0f05cc9cb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 14:49:58.485045 12840 tablet_service.cc:1467] Processing CreateTablet for tablet ca16be07404d4fa096bcff43bebef35f (DEFAULT_TABLE table=TestTable [id=c90777b6b27346f396ca6c0f05cc9cb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 14:49:58.485165 12971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca16be07404d4fa096bcff43bebef35f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 14:49:58.485258 13102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca16be07404d4fa096bcff43bebef35f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 14:49:58.485323 12840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca16be07404d4fa096bcff43bebef35f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 14:49:58.487432 13182 tablet_bootstrap.cc:492] T ca16be07404d4fa096bcff43bebef35f P 2cd8fa8105174954b5d42c8a9b07f7b1: Bootstrap starting.
I20260925 14:49:58.487967 13182 tablet_bootstrap.cc:654] T ca16be07404d4fa096bcff43bebef35f P 2cd8fa8105174954b5d42c8a9b07f7b1: Neither blocks nor log segments found. Creating new log.
I20260925 14:49:58.488188 13184 tablet_bootstrap.cc:492] T ca16be07404d4fa096bcff43bebef35f P 574f4a1c05a4462eb39a08bb52954a8e: Bootstrap starting.
I20260925 14:49:58.488428 13182 log.cc:824] T ca16be07404d4fa096bcff43bebef35f P 2cd8fa8105174954b5d42c8a9b07f7b1: Log is configured to *not* fsync() on all Append() calls
I20260925 14:49:58.488752 13183 tablet_bootstrap.cc:492] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b: Bootstrap starting.
I20260925 14:49:58.488803 13184 tablet_bootstrap.cc:654] T ca16be07404d4fa096bcff43bebef35f P 574f4a1c05a4462eb39a08bb52954a8e: Neither blocks nor log segments found. Creating new log.
I20260925 14:49:58.489044 13182 tablet_bootstrap.cc:492] T ca16be07404d4fa096bcff43bebef35f P 2cd8fa8105174954b5d42c8a9b07f7b1: No bootstrap required, opened a new log
I20260925 14:49:58.489104 13182 ts_tablet_manager.cc:1397] T ca16be07404d4fa096bcff43bebef35f P 2cd8fa8105174954b5d42c8a9b07f7b1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260925 14:49:58.489559 13183 tablet_bootstrap.cc:654] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b: Neither blocks nor log segments found. Creating new log.
I20260925 14:49:58.489624 13184 log.cc:824] T ca16be07404d4fa096bcff43bebef35f P 574f4a1c05a4462eb39a08bb52954a8e: Log is configured to *not* fsync() on all Append() calls
I20260925 14:49:58.489837 13183 log.cc:824] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b: Log is configured to *not* fsync() on all Append() calls
I20260925 14:49:58.490283 13184 tablet_bootstrap.cc:492] T ca16be07404d4fa096bcff43bebef35f P 574f4a1c05a4462eb39a08bb52954a8e: No bootstrap required, opened a new log
I20260925 14:49:58.490376 13184 ts_tablet_manager.cc:1397] T ca16be07404d4fa096bcff43bebef35f P 574f4a1c05a4462eb39a08bb52954a8e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260925 14:49:58.490417 13183 tablet_bootstrap.cc:492] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b: No bootstrap required, opened a new log
I20260925 14:49:58.490469 13183 ts_tablet_manager.cc:1397] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260925 14:49:58.491341 13182 raft_consensus.cc:348] T ca16be07404d4fa096bcff43bebef35f P 2cd8fa8105174954b5d42c8a9b07f7b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd8fa8105174954b5d42c8a9b07f7b1" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 43179 } } peers { permanent_uuid: "37f8f0cb04964a5d82845ca1e389ca8b" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 45563 } } peers { permanent_uuid: "574f4a1c05a4462eb39a08bb52954a8e" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 37445 } }
I20260925 14:49:58.491492 13182 raft_consensus.cc:374] T ca16be07404d4fa096bcff43bebef35f P 2cd8fa8105174954b5d42c8a9b07f7b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 14:49:58.491523 13182 raft_consensus.cc:729] T ca16be07404d4fa096bcff43bebef35f P 2cd8fa8105174954b5d42c8a9b07f7b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd8fa8105174954b5d42c8a9b07f7b1, State: Initialized, Role: FOLLOWER
I20260925 14:49:58.491621 13182 consensus_queue.cc:260] T ca16be07404d4fa096bcff43bebef35f P 2cd8fa8105174954b5d42c8a9b07f7b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd8fa8105174954b5d42c8a9b07f7b1" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 43179 } } peers { permanent_uuid: "37f8f0cb04964a5d82845ca1e389ca8b" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 45563 } } peers { permanent_uuid: "574f4a1c05a4462eb39a08bb52954a8e" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 37445 } }
I20260925 14:49:58.491847 13182 ts_tablet_manager.cc:1428] T ca16be07404d4fa096bcff43bebef35f P 2cd8fa8105174954b5d42c8a9b07f7b1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260925 14:49:58.491883 13037 heartbeater.cc:503] Master 127.12.96.254:35295 was elected leader, sending a full tablet report...
I20260925 14:49:58.492758 13183 raft_consensus.cc:348] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd8fa8105174954b5d42c8a9b07f7b1" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 43179 } } peers { permanent_uuid: "37f8f0cb04964a5d82845ca1e389ca8b" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 45563 } } peers { permanent_uuid: "574f4a1c05a4462eb39a08bb52954a8e" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 37445 } }
I20260925 14:49:58.492903 13183 raft_consensus.cc:374] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 14:49:58.492933 13183 raft_consensus.cc:729] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37f8f0cb04964a5d82845ca1e389ca8b, State: Initialized, Role: FOLLOWER
I20260925 14:49:58.493047 13183 consensus_queue.cc:260] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd8fa8105174954b5d42c8a9b07f7b1" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 43179 } } peers { permanent_uuid: "37f8f0cb04964a5d82845ca1e389ca8b" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 45563 } } peers { permanent_uuid: "574f4a1c05a4462eb39a08bb52954a8e" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 37445 } }
I20260925 14:49:58.493034 13184 raft_consensus.cc:348] T ca16be07404d4fa096bcff43bebef35f P 574f4a1c05a4462eb39a08bb52954a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd8fa8105174954b5d42c8a9b07f7b1" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 43179 } } peers { permanent_uuid: "37f8f0cb04964a5d82845ca1e389ca8b" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 45563 } } peers { permanent_uuid: "574f4a1c05a4462eb39a08bb52954a8e" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 37445 } }
I20260925 14:49:58.493160 13184 raft_consensus.cc:374] T ca16be07404d4fa096bcff43bebef35f P 574f4a1c05a4462eb39a08bb52954a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 14:49:58.493191 13184 raft_consensus.cc:729] T ca16be07404d4fa096bcff43bebef35f P 574f4a1c05a4462eb39a08bb52954a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 574f4a1c05a4462eb39a08bb52954a8e, State: Initialized, Role: FOLLOWER
I20260925 14:49:58.493289 13183 ts_tablet_manager.cc:1428] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260925 14:49:58.493330 12906 heartbeater.cc:503] Master 127.12.96.254:35295 was elected leader, sending a full tablet report...
I20260925 14:49:58.493283 13184 consensus_queue.cc:260] T ca16be07404d4fa096bcff43bebef35f P 574f4a1c05a4462eb39a08bb52954a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd8fa8105174954b5d42c8a9b07f7b1" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 43179 } } peers { permanent_uuid: "37f8f0cb04964a5d82845ca1e389ca8b" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 45563 } } peers { permanent_uuid: "574f4a1c05a4462eb39a08bb52954a8e" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 37445 } }
I20260925 14:49:58.493613 13184 ts_tablet_manager.cc:1428] T ca16be07404d4fa096bcff43bebef35f P 574f4a1c05a4462eb39a08bb52954a8e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260925 14:49:58.493666 13168 heartbeater.cc:503] Master 127.12.96.254:35295 was elected leader, sending a full tablet report...
W20260925 14:49:58.572605 13038 tablet.cc:2369] T ca16be07404d4fa096bcff43bebef35f P 2cd8fa8105174954b5d42c8a9b07f7b1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260925 14:49:58.651631 13189 raft_consensus.cc:482] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 14:49:58.651753 13189 raft_consensus.cc:504] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd8fa8105174954b5d42c8a9b07f7b1" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 43179 } } peers { permanent_uuid: "37f8f0cb04964a5d82845ca1e389ca8b" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 45563 } } peers { permanent_uuid: "574f4a1c05a4462eb39a08bb52954a8e" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 37445 } }
I20260925 14:49:58.652104 13189 leader_election.cc:288] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cd8fa8105174954b5d42c8a9b07f7b1 (127.12.96.194:43179), 574f4a1c05a4462eb39a08bb52954a8e (127.12.96.195:37445)
I20260925 14:49:58.655089 12991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca16be07404d4fa096bcff43bebef35f" candidate_uuid: "37f8f0cb04964a5d82845ca1e389ca8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd8fa8105174954b5d42c8a9b07f7b1" is_pre_election: true
I20260925 14:49:58.655082 13122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca16be07404d4fa096bcff43bebef35f" candidate_uuid: "37f8f0cb04964a5d82845ca1e389ca8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574f4a1c05a4462eb39a08bb52954a8e" is_pre_election: true
I20260925 14:49:58.655230 12991 raft_consensus.cc:2454] T ca16be07404d4fa096bcff43bebef35f P 2cd8fa8105174954b5d42c8a9b07f7b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37f8f0cb04964a5d82845ca1e389ca8b in term 0.
I20260925 14:49:58.655236 13122 raft_consensus.cc:2454] T ca16be07404d4fa096bcff43bebef35f P 574f4a1c05a4462eb39a08bb52954a8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37f8f0cb04964a5d82845ca1e389ca8b in term 0.
I20260925 14:49:58.655434 12795 leader_election.cc:302] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cd8fa8105174954b5d42c8a9b07f7b1, 37f8f0cb04964a5d82845ca1e389ca8b; no voters:
I20260925 14:49:58.655576 13189 raft_consensus.cc:2781] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 14:49:58.655632 13189 raft_consensus.cc:482] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 14:49:58.655653 13189 raft_consensus.cc:3037] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b [term 0 FOLLOWER]: Advancing to term 1
I20260925 14:49:58.656813 13189 raft_consensus.cc:504] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd8fa8105174954b5d42c8a9b07f7b1" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 43179 } } peers { permanent_uuid: "37f8f0cb04964a5d82845ca1e389ca8b" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 45563 } } peers { permanent_uuid: "574f4a1c05a4462eb39a08bb52954a8e" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 37445 } }
I20260925 14:49:58.656932 13189 leader_election.cc:288] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b [CANDIDATE]: Term 1 election: Requested vote from peers 2cd8fa8105174954b5d42c8a9b07f7b1 (127.12.96.194:43179), 574f4a1c05a4462eb39a08bb52954a8e (127.12.96.195:37445)
I20260925 14:49:58.657109 12991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca16be07404d4fa096bcff43bebef35f" candidate_uuid: "37f8f0cb04964a5d82845ca1e389ca8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cd8fa8105174954b5d42c8a9b07f7b1"
I20260925 14:49:58.657117 13122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca16be07404d4fa096bcff43bebef35f" candidate_uuid: "37f8f0cb04964a5d82845ca1e389ca8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574f4a1c05a4462eb39a08bb52954a8e"
I20260925 14:49:58.657173 12991 raft_consensus.cc:3037] T ca16be07404d4fa096bcff43bebef35f P 2cd8fa8105174954b5d42c8a9b07f7b1 [term 0 FOLLOWER]: Advancing to term 1
I20260925 14:49:58.657186 13122 raft_consensus.cc:3037] T ca16be07404d4fa096bcff43bebef35f P 574f4a1c05a4462eb39a08bb52954a8e [term 0 FOLLOWER]: Advancing to term 1
I20260925 14:49:58.657825 12991 raft_consensus.cc:2454] T ca16be07404d4fa096bcff43bebef35f P 2cd8fa8105174954b5d42c8a9b07f7b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37f8f0cb04964a5d82845ca1e389ca8b in term 1.
I20260925 14:49:58.657830 13122 raft_consensus.cc:2454] T ca16be07404d4fa096bcff43bebef35f P 574f4a1c05a4462eb39a08bb52954a8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37f8f0cb04964a5d82845ca1e389ca8b in term 1.
I20260925 14:49:58.657982 12795 leader_election.cc:302] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cd8fa8105174954b5d42c8a9b07f7b1, 37f8f0cb04964a5d82845ca1e389ca8b; no voters:
I20260925 14:49:58.658077 13189 raft_consensus.cc:2781] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b [term 1 FOLLOWER]: Leader election won for term 1
I20260925 14:49:58.658221 13189 raft_consensus.cc:686] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b [term 1 LEADER]: Becoming Leader. State: Replica: 37f8f0cb04964a5d82845ca1e389ca8b, State: Running, Role: LEADER
I20260925 14:49:58.658300 13189 consensus_queue.cc:237] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd8fa8105174954b5d42c8a9b07f7b1" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 43179 } } peers { permanent_uuid: "37f8f0cb04964a5d82845ca1e389ca8b" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 45563 } } peers { permanent_uuid: "574f4a1c05a4462eb39a08bb52954a8e" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 37445 } }
I20260925 14:49:58.659127 12718 catalog_manager.cc:5495] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b reported cstate change: term changed from 0 to 1, leader changed from <none> to 37f8f0cb04964a5d82845ca1e389ca8b (127.12.96.193). New cstate: current_term: 1 leader_uuid: "37f8f0cb04964a5d82845ca1e389ca8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd8fa8105174954b5d42c8a9b07f7b1" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 43179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37f8f0cb04964a5d82845ca1e389ca8b" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 45563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "574f4a1c05a4462eb39a08bb52954a8e" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 37445 } health_report { overall_health: UNKNOWN } } }
I20260925 14:49:58.663332 12675 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260925 14:49:58.663885 12675 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 37f8f0cb04964a5d82845ca1e389ca8b to finish bootstrapping
I20260925 14:49:58.667220 12675 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 2cd8fa8105174954b5d42c8a9b07f7b1 to finish bootstrapping
I20260925 14:49:58.670063 12675 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 574f4a1c05a4462eb39a08bb52954a8e to finish bootstrapping
I20260925 14:49:58.680604 12675 cluster_itest_util.cc:256] Not converged past 1 yet: 0.0 0.0 1.1
W20260925 14:49:58.700111 12907 tablet.cc:2369] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260925 14:49:58.708247 13169 tablet.cc:2369] T ca16be07404d4fa096bcff43bebef35f P 574f4a1c05a4462eb39a08bb52954a8e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260925 14:49:58.781689 12675 cluster_itest_util.cc:256] Not converged past 1 yet: 0.0 0.0 1.1
I20260925 14:49:58.983007 12675 cluster_itest_util.cc:256] Not converged past 1 yet: 0.0 0.0 1.1
I20260925 14:49:59.255041 13197 consensus_queue.cc:1035] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd8fa8105174954b5d42c8a9b07f7b1" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 43179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 14:49:59.255203 13196 consensus_queue.cc:1035] T ca16be07404d4fa096bcff43bebef35f P 37f8f0cb04964a5d82845ca1e389ca8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "574f4a1c05a4462eb39a08bb52954a8e" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 37445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260925 14:49:59.285933 13203 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:39596: Not implemented: Unknown operation type: 115
I20260925 14:49:59.315326 13102 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260925 14:49:59.315430 12840 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260925 14:49:59.315860 12971 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+---------------------+---------
b260158d351a47b6a703877f0f131364 | 127.12.96.254:35295 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.12.96.212:45673 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
2cd8fa8105174954b5d42c8a9b07f7b1 | 127.12.96.194:43179 | HEALTHY | <none> | 0 | 0
37f8f0cb04964a5d82845ca1e389ca8b | 127.12.96.193:45563 | HEALTHY | <none> | 1 | 0
574f4a1c05a4462eb39a08bb52954a8e | 127.12.96.195:37445 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.12.96.193 | experimental | 127.12.96.193:45563
local_ip_for_outbound_sockets | 127.12.96.194 | experimental | 127.12.96.194:43179
local_ip_for_outbound_sockets | 127.12.96.195 | experimental | 127.12.96.195:37445
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.12.96.193:45563
server_dump_info_path | /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.12.96.194:43179
server_dump_info_path | /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.TestFailedOp.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.12.96.195:37445
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.12.96.212:45673 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-----------+----+---------+---------------+---------+------------+------------------+-------------
TestTable | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260925 14:49:59.324523 12675 log_verifier.cc:126] Checking tablet ca16be07404d4fa096bcff43bebef35f
I20260925 14:49:59.341154 12675 log_verifier.cc:177] Verified matching terms for 2 ops in tablet ca16be07404d4fa096bcff43bebef35f
I20260925 14:49:59.770368 12675 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKe2EOk/build/release/bin/kudu with pid 12778
I20260925 14:49:59.775848 12675 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKe2EOk/build/release/bin/kudu with pid 12909
I20260925 14:49:59.780462 12675 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKe2EOk/build/release/bin/kudu with pid 13040
I20260925 14:49:59.784235 12675 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKe2EOk/build/release/bin/kudu with pid 12687
2026-09-25T14:49:59Z chronyd exiting
[ OK ] RaftConsensusITest.TestFailedOp (1917 ms)
[ RUN ] RaftConsensusITest.MultiThreadedInsertWithFailovers
I20260925 14:49:59.803974 12675 test_util.cc:268] Using random seed: -727599037
I20260925 14:49:59.804538 12675 ts_itest-base.cc:112] Starting cluster with:
I20260925 14:49:59.804574 12675 ts_itest-base.cc:113] --------------
I20260925 14:49:59.804584 12675 ts_itest-base.cc:114] 7 tablet servers
I20260925 14:49:59.804593 12675 ts_itest-base.cc:115] 7 replicas per TS
I20260925 14:49:59.804603 12675 ts_itest-base.cc:116] --------------
2026-09-25T14:49:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-25T14:49:59Z Disabled control of system clock
I20260925 14:49:59.811303 12675 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKe2EOk/build/release/bin/kudu
/tmp/dist-test-taskKe2EOk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.96.254:44023
--webserver_interface=127.12.96.254
--webserver_port=0
--builtin_ntp_servers=127.12.96.212:40653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.96.254:44023 with env {}
W20260925 14:49:59.887337 13250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 14:49:59.887516 13250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 14:49:59.887534 13250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 14:49:59.888669 13250 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260925 14:49:59.888705 13250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 14:49:59.888716 13250 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260925 14:49:59.888726 13250 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260925 14:49:59.889971 13250 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.96.212:40653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.96.254:44023
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.96.254:44023
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.12.96.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.13250
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 25 Sep 2026 13:57:57 UTC on ccycloud.quasar-zfbtwj.root.comops.site
build id 4672727
I20260925 14:49:59.890151 13250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 14:49:59.890369 13250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 14:49:59.894743 13256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 14:49:59.894778 13258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 14:49:59.894794 13250 server_base.cc:1034] running on GCE node
W20260925 14:49:59.894752 13255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 14:49:59.895161 13250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 14:49:59.895385 13250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 14:49:59.896533 13250 hybrid_clock.cc:648] HybridClock initialized: now 1790347799896522 us; error 25 us; skew 500 ppm
I20260925 14:49:59.897615 13250 webserver.cc:460] Webserver started at http://127.12.96.254:38803/ using document root <none> and password file <none>
I20260925 14:49:59.897828 13250 fs_manager.cc:359] Metadata directory not provided
I20260925 14:49:59.897871 13250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 14:49:59.897957 13250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 14:49:59.898861 13250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "7bc601a7c0374715bc4ef8c023444ddf"
format_stamp: "Formatted at 2026-09-25 14:49:59 on dist-test-slave-nsrc"
I20260925 14:49:59.899138 13250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "7bc601a7c0374715bc4ef8c023444ddf"
format_stamp: "Formatted at 2026-09-25 14:49:59 on dist-test-slave-nsrc"
I20260925 14:49:59.900214 13250 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260925 14:49:59.900800 13264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 14:49:59.900944 13250 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260925 14:49:59.901018 13250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/wal
uuid: "7bc601a7c0374715bc4ef8c023444ddf"
format_stamp: "Formatted at 2026-09-25 14:49:59 on dist-test-slave-nsrc"
I20260925 14:49:59.901067 13250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 14:49:59.912613 13250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 14:49:59.912825 13250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 14:49:59.912912 13250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 14:49:59.916272 13250 rpc_server.cc:307] RPC server started. Bound to: 127.12.96.254:44023
I20260925 14:49:59.916302 13316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.96.254:44023 every 8 connection(s)
I20260925 14:49:59.916585 13250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260925 14:49:59.917156 13317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 14:49:59.919447 13317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf: Bootstrap starting.
I20260925 14:49:59.919948 13317 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf: Neither blocks nor log segments found. Creating new log.
I20260925 14:49:59.920217 13317 log.cc:824] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf: Log is configured to *not* fsync() on all Append() calls
I20260925 14:49:59.920732 13317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf: No bootstrap required, opened a new log
I20260925 14:49:59.922145 13317 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bc601a7c0374715bc4ef8c023444ddf" member_type: VOTER last_known_addr { host: "127.12.96.254" port: 44023 } }
I20260925 14:49:59.922268 13317 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 14:49:59.922295 13317 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc601a7c0374715bc4ef8c023444ddf, State: Initialized, Role: FOLLOWER
I20260925 14:49:59.922407 13317 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bc601a7c0374715bc4ef8c023444ddf" member_type: VOTER last_known_addr { host: "127.12.96.254" port: 44023 } }
I20260925 14:49:59.922477 13317 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260925 14:49:59.922513 13317 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260925 14:49:59.922545 13317 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf [term 0 FOLLOWER]: Advancing to term 1
I20260925 14:49:59.922955 13317 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bc601a7c0374715bc4ef8c023444ddf" member_type: VOTER last_known_addr { host: "127.12.96.254" port: 44023 } }
I20260925 14:49:59.923035 13317 leader_election.cc:302] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7bc601a7c0374715bc4ef8c023444ddf; no voters:
I20260925 14:49:59.923142 13317 leader_election.cc:288] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260925 14:49:59.923175 13320 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf [term 1 FOLLOWER]: Leader election won for term 1
I20260925 14:49:59.923285 13320 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf [term 1 LEADER]: Becoming Leader. State: Replica: 7bc601a7c0374715bc4ef8c023444ddf, State: Running, Role: LEADER
I20260925 14:49:59.923360 13317 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf [sys.catalog]: configured and running, proceeding with master startup.
I20260925 14:49:59.923372 13320 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bc601a7c0374715bc4ef8c023444ddf" member_type: VOTER last_known_addr { host: "127.12.96.254" port: 44023 } }
I20260925 14:49:59.923693 13322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7bc601a7c0374715bc4ef8c023444ddf. Latest consensus state: current_term: 1 leader_uuid: "7bc601a7c0374715bc4ef8c023444ddf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bc601a7c0374715bc4ef8c023444ddf" member_type: VOTER last_known_addr { host: "127.12.96.254" port: 44023 } } }
I20260925 14:49:59.923774 13322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf [sys.catalog]: This master's current role is: LEADER
I20260925 14:49:59.923686 13321 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7bc601a7c0374715bc4ef8c023444ddf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bc601a7c0374715bc4ef8c023444ddf" member_type: VOTER last_known_addr { host: "127.12.96.254" port: 44023 } } }
I20260925 14:49:59.923918 13321 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf [sys.catalog]: This master's current role is: LEADER
I20260925 14:49:59.924515 13327 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260925 14:49:59.924633 12675 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKe2EOk/build/release/bin/kudu as pid 13250
I20260925 14:49:59.924710 12675 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260925 14:49:59.925026 13327 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260925 14:49:59.926452 13327 catalog_manager.cc:1347] Generated new cluster ID: 102bc32d25854b2786f2d41ee4147f67
I20260925 14:49:59.926499 13327 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260925 14:49:59.935105 13327 catalog_manager.cc:1370] Generated new certificate authority record
I20260925 14:49:59.935557 13327 catalog_manager.cc:1504] Loading token signing keys...
I20260925 14:49:59.945623 13327 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7bc601a7c0374715bc4ef8c023444ddf: Generated new TSK 0
I20260925 14:49:59.945794 13327 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260925 14:49:59.951757 12675 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKe2EOk/build/release/bin/kudu
/tmp/dist-test-taskKe2EOk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.96.193:0
--local_ip_for_outbound_sockets=127.12.96.193
--webserver_interface=127.12.96.193
--webserver_port=0
--tserver_master_addrs=127.12.96.254:44023
--builtin_ntp_servers=127.12.96.212:40653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=1000 with env {}
W20260925 14:50:00.029572 13341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 14:50:00.029772 13341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 14:50:00.029790 13341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 14:50:00.030953 13341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 14:50:00.031008 13341 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.96.193
I20260925 14:50:00.032341 13341 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.96.212:40653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=1000
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.96.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.12.96.193
--webserver_port=0
--tserver_master_addrs=127.12.96.254:44023
--never_fsync=true
--heap_profile_path=/tmp/kudu.13341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.96.193
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 25 Sep 2026 13:57:57 UTC on ccycloud.quasar-zfbtwj.root.comops.site
build id 4672727
I20260925 14:50:00.032557 13341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 14:50:00.032829 13341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 14:50:00.038581 13346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 14:50:00.038645 13347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 14:50:00.038846 13349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 14:50:00.038988 13341 server_base.cc:1034] running on GCE node
I20260925 14:50:00.039183 13341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 14:50:00.039410 13341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 14:50:00.040550 13341 hybrid_clock.cc:648] HybridClock initialized: now 1790347800040534 us; error 32 us; skew 500 ppm
I20260925 14:50:00.041729 13341 webserver.cc:460] Webserver started at http://127.12.96.193:38897/ using document root <none> and password file <none>
I20260925 14:50:00.041958 13341 fs_manager.cc:359] Metadata directory not provided
I20260925 14:50:00.042011 13341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 14:50:00.042135 13341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 14:50:00.043129 13341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "15f60cba26104c4b9ebb52818978c1d3"
format_stamp: "Formatted at 2026-09-25 14:50:00 on dist-test-slave-nsrc"
I20260925 14:50:00.043457 13341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "15f60cba26104c4b9ebb52818978c1d3"
format_stamp: "Formatted at 2026-09-25 14:50:00 on dist-test-slave-nsrc"
I20260925 14:50:00.044790 13341 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260925 14:50:00.045531 13355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.045699 13341 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260925 14:50:00.045789 13341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "15f60cba26104c4b9ebb52818978c1d3"
format_stamp: "Formatted at 2026-09-25 14:50:00 on dist-test-slave-nsrc"
I20260925 14:50:00.045871 13341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 14:50:00.058871 13341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 14:50:00.059181 13341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 14:50:00.059293 13341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 14:50:00.059499 13341 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 14:50:00.059804 13341 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 14:50:00.059835 13341 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.059856 13341 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 14:50:00.059880 13341 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.065244 13341 rpc_server.cc:307] RPC server started. Bound to: 127.12.96.193:34571
I20260925 14:50:00.065296 13468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.96.193:34571 every 8 connection(s)
I20260925 14:50:00.065618 13341 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260925 14:50:00.066267 12675 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKe2EOk/build/release/bin/kudu as pid 13341
I20260925 14:50:00.066349 12675 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260925 14:50:00.067402 12675 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKe2EOk/build/release/bin/kudu
/tmp/dist-test-taskKe2EOk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.96.194:0
--local_ip_for_outbound_sockets=127.12.96.194
--webserver_interface=127.12.96.194
--webserver_port=0
--tserver_master_addrs=127.12.96.254:44023
--builtin_ntp_servers=127.12.96.212:40653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=1000 with env {}
I20260925 14:50:00.071318 13469 heartbeater.cc:347] Connected to a master server at 127.12.96.254:44023
I20260925 14:50:00.071408 13469 heartbeater.cc:464] Registering TS with master...
I20260925 14:50:00.071588 13469 heartbeater.cc:511] Master 127.12.96.254:44023 requested a full tablet report, sending...
I20260925 14:50:00.072101 13281 ts_manager.cc:194] Registered new tserver with Master: 15f60cba26104c4b9ebb52818978c1d3 (127.12.96.193:34571)
I20260925 14:50:00.073032 13281 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.96.193:57437
W20260925 14:50:00.148775 13472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 14:50:00.148985 13472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 14:50:00.149006 13472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 14:50:00.150213 13472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 14:50:00.150267 13472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.96.194
I20260925 14:50:00.151580 13472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.96.212:40653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=1000
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.96.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.12.96.194
--webserver_port=0
--tserver_master_addrs=127.12.96.254:44023
--never_fsync=true
--heap_profile_path=/tmp/kudu.13472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.96.194
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 25 Sep 2026 13:57:57 UTC on ccycloud.quasar-zfbtwj.root.comops.site
build id 4672727
I20260925 14:50:00.151790 13472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 14:50:00.152079 13472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 14:50:00.156925 13477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 14:50:00.156894 13480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 14:50:00.156983 13472 server_base.cc:1034] running on GCE node
W20260925 14:50:00.156894 13478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 14:50:00.157330 13472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 14:50:00.157544 13472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 14:50:00.158697 13472 hybrid_clock.cc:648] HybridClock initialized: now 1790347800158683 us; error 31 us; skew 500 ppm
I20260925 14:50:00.159937 13472 webserver.cc:460] Webserver started at http://127.12.96.194:35741/ using document root <none> and password file <none>
I20260925 14:50:00.160180 13472 fs_manager.cc:359] Metadata directory not provided
I20260925 14:50:00.160233 13472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 14:50:00.160356 13472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 14:50:00.161376 13472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "701c21bd0bd34d0e9e56f196738cbd11"
format_stamp: "Formatted at 2026-09-25 14:50:00 on dist-test-slave-nsrc"
I20260925 14:50:00.161705 13472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "701c21bd0bd34d0e9e56f196738cbd11"
format_stamp: "Formatted at 2026-09-25 14:50:00 on dist-test-slave-nsrc"
I20260925 14:50:00.162902 13472 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260925 14:50:00.163620 13486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.163754 13472 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260925 14:50:00.163829 13472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "701c21bd0bd34d0e9e56f196738cbd11"
format_stamp: "Formatted at 2026-09-25 14:50:00 on dist-test-slave-nsrc"
I20260925 14:50:00.163884 13472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 14:50:00.171581 13472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 14:50:00.171826 13472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 14:50:00.171936 13472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 14:50:00.172127 13472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 14:50:00.172461 13472 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 14:50:00.172493 13472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.172519 13472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 14:50:00.172536 13472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.177747 13472 rpc_server.cc:307] RPC server started. Bound to: 127.12.96.194:37593
I20260925 14:50:00.177796 13599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.96.194:37593 every 8 connection(s)
I20260925 14:50:00.178109 13472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260925 14:50:00.181924 12675 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKe2EOk/build/release/bin/kudu as pid 13472
I20260925 14:50:00.182025 12675 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260925 14:50:00.183064 12675 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKe2EOk/build/release/bin/kudu
/tmp/dist-test-taskKe2EOk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.96.195:0
--local_ip_for_outbound_sockets=127.12.96.195
--webserver_interface=127.12.96.195
--webserver_port=0
--tserver_master_addrs=127.12.96.254:44023
--builtin_ntp_servers=127.12.96.212:40653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=1000 with env {}
I20260925 14:50:00.183615 13600 heartbeater.cc:347] Connected to a master server at 127.12.96.254:44023
I20260925 14:50:00.183696 13600 heartbeater.cc:464] Registering TS with master...
I20260925 14:50:00.183858 13600 heartbeater.cc:511] Master 127.12.96.254:44023 requested a full tablet report, sending...
I20260925 14:50:00.184218 13281 ts_manager.cc:194] Registered new tserver with Master: 701c21bd0bd34d0e9e56f196738cbd11 (127.12.96.194:37593)
I20260925 14:50:00.184615 13281 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.96.194:49623
W20260925 14:50:00.262691 13603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 14:50:00.262900 13603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 14:50:00.262928 13603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 14:50:00.264074 13603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 14:50:00.264129 13603 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.96.195
I20260925 14:50:00.265463 13603 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.96.212:40653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=1000
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.96.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.12.96.195
--webserver_port=0
--tserver_master_addrs=127.12.96.254:44023
--never_fsync=true
--heap_profile_path=/tmp/kudu.13603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.96.195
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 25 Sep 2026 13:57:57 UTC on ccycloud.quasar-zfbtwj.root.comops.site
build id 4672727
I20260925 14:50:00.265686 13603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 14:50:00.265945 13603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 14:50:00.270700 13611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 14:50:00.270691 13609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 14:50:00.270691 13608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 14:50:00.270998 13603 server_base.cc:1034] running on GCE node
I20260925 14:50:00.271209 13603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 14:50:00.271462 13603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 14:50:00.272631 13603 hybrid_clock.cc:648] HybridClock initialized: now 1790347800272617 us; error 33 us; skew 500 ppm
I20260925 14:50:00.273857 13603 webserver.cc:460] Webserver started at http://127.12.96.195:38345/ using document root <none> and password file <none>
I20260925 14:50:00.274107 13603 fs_manager.cc:359] Metadata directory not provided
I20260925 14:50:00.274158 13603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 14:50:00.274284 13603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 14:50:00.275249 13603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "bee1b311890c4c16a344bbde7933c838"
format_stamp: "Formatted at 2026-09-25 14:50:00 on dist-test-slave-nsrc"
I20260925 14:50:00.276880 13603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "bee1b311890c4c16a344bbde7933c838"
format_stamp: "Formatted at 2026-09-25 14:50:00 on dist-test-slave-nsrc"
I20260925 14:50:00.280004 13603 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.000s
I20260925 14:50:00.280884 13617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.281091 13603 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260925 14:50:00.281183 13603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "bee1b311890c4c16a344bbde7933c838"
format_stamp: "Formatted at 2026-09-25 14:50:00 on dist-test-slave-nsrc"
I20260925 14:50:00.281255 13603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 14:50:00.300446 13603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 14:50:00.300750 13603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 14:50:00.300879 13603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 14:50:00.301115 13603 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 14:50:00.301436 13603 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 14:50:00.301472 13603 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.301502 13603 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 14:50:00.301519 13603 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.306829 13603 rpc_server.cc:307] RPC server started. Bound to: 127.12.96.195:44787
I20260925 14:50:00.306890 13730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.96.195:44787 every 8 connection(s)
I20260925 14:50:00.307188 13603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260925 14:50:00.307871 12675 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKe2EOk/build/release/bin/kudu as pid 13603
I20260925 14:50:00.307946 12675 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260925 14:50:00.308987 12675 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKe2EOk/build/release/bin/kudu
/tmp/dist-test-taskKe2EOk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.96.196:0
--local_ip_for_outbound_sockets=127.12.96.196
--webserver_interface=127.12.96.196
--webserver_port=0
--tserver_master_addrs=127.12.96.254:44023
--builtin_ntp_servers=127.12.96.212:40653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=1000 with env {}
I20260925 14:50:00.313401 13731 heartbeater.cc:347] Connected to a master server at 127.12.96.254:44023
I20260925 14:50:00.313493 13731 heartbeater.cc:464] Registering TS with master...
I20260925 14:50:00.313660 13731 heartbeater.cc:511] Master 127.12.96.254:44023 requested a full tablet report, sending...
I20260925 14:50:00.313982 13281 ts_manager.cc:194] Registered new tserver with Master: bee1b311890c4c16a344bbde7933c838 (127.12.96.195:44787)
I20260925 14:50:00.314323 13281 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.96.195:50477
W20260925 14:50:00.390326 13734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 14:50:00.390529 13734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 14:50:00.390558 13734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 14:50:00.391700 13734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 14:50:00.391757 13734 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.96.196
I20260925 14:50:00.393093 13734 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.96.212:40653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=1000
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.96.196:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.12.96.196
--webserver_port=0
--tserver_master_addrs=127.12.96.254:44023
--never_fsync=true
--heap_profile_path=/tmp/kudu.13734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.96.196
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 25 Sep 2026 13:57:57 UTC on ccycloud.quasar-zfbtwj.root.comops.site
build id 4672727
I20260925 14:50:00.393340 13734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 14:50:00.393615 13734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 14:50:00.398172 13739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 14:50:00.398298 13742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 14:50:00.398171 13740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 14:50:00.398545 13734 server_base.cc:1034] running on GCE node
I20260925 14:50:00.398746 13734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 14:50:00.399000 13734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 14:50:00.400174 13734 hybrid_clock.cc:648] HybridClock initialized: now 1790347800400127 us; error 33 us; skew 500 ppm
I20260925 14:50:00.401443 13734 webserver.cc:460] Webserver started at http://127.12.96.196:42125/ using document root <none> and password file <none>
I20260925 14:50:00.401648 13734 fs_manager.cc:359] Metadata directory not provided
I20260925 14:50:00.401696 13734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 14:50:00.401827 13734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 14:50:00.402787 13734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "96d28122a9b140369b9a9dd3a2432d6a"
format_stamp: "Formatted at 2026-09-25 14:50:00 on dist-test-slave-nsrc"
I20260925 14:50:00.403151 13734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "96d28122a9b140369b9a9dd3a2432d6a"
format_stamp: "Formatted at 2026-09-25 14:50:00 on dist-test-slave-nsrc"
I20260925 14:50:00.404532 13734 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260925 14:50:00.405256 13748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.405416 13734 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260925 14:50:00.405517 13734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "96d28122a9b140369b9a9dd3a2432d6a"
format_stamp: "Formatted at 2026-09-25 14:50:00 on dist-test-slave-nsrc"
I20260925 14:50:00.405587 13734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 14:50:00.427699 13734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 14:50:00.427965 13734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 14:50:00.428062 13734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 14:50:00.428274 13734 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 14:50:00.428552 13734 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 14:50:00.428581 13734 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.428601 13734 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 14:50:00.428612 13734 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.433614 13734 rpc_server.cc:307] RPC server started. Bound to: 127.12.96.196:43999
I20260925 14:50:00.433678 13861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.96.196:43999 every 8 connection(s)
I20260925 14:50:00.433951 13734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20260925 14:50:00.439209 13862 heartbeater.cc:347] Connected to a master server at 127.12.96.254:44023
I20260925 14:50:00.439294 13862 heartbeater.cc:464] Registering TS with master...
I20260925 14:50:00.439446 13862 heartbeater.cc:511] Master 127.12.96.254:44023 requested a full tablet report, sending...
I20260925 14:50:00.439775 13281 ts_manager.cc:194] Registered new tserver with Master: 96d28122a9b140369b9a9dd3a2432d6a (127.12.96.196:43999)
I20260925 14:50:00.440128 13281 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.96.196:48541
I20260925 14:50:00.444027 12675 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKe2EOk/build/release/bin/kudu as pid 13734
I20260925 14:50:00.444090 12675 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20260925 14:50:00.445020 12675 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKe2EOk/build/release/bin/kudu
/tmp/dist-test-taskKe2EOk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.96.197:0
--local_ip_for_outbound_sockets=127.12.96.197
--webserver_interface=127.12.96.197
--webserver_port=0
--tserver_master_addrs=127.12.96.254:44023
--builtin_ntp_servers=127.12.96.212:40653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=1000 with env {}
W20260925 14:50:00.522862 13865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 14:50:00.523063 13865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 14:50:00.523089 13865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 14:50:00.524336 13865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 14:50:00.524386 13865 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.96.197
I20260925 14:50:00.525713 13865 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.96.212:40653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=1000
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.96.197:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.12.96.197
--webserver_port=0
--tserver_master_addrs=127.12.96.254:44023
--never_fsync=true
--heap_profile_path=/tmp/kudu.13865
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.96.197
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 25 Sep 2026 13:57:57 UTC on ccycloud.quasar-zfbtwj.root.comops.site
build id 4672727
I20260925 14:50:00.525925 13865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 14:50:00.526180 13865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 14:50:00.530687 13871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 14:50:00.530725 13873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 14:50:00.530702 13870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 14:50:00.530866 13865 server_base.cc:1034] running on GCE node
I20260925 14:50:00.531124 13865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 14:50:00.531328 13865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 14:50:00.532456 13865 hybrid_clock.cc:648] HybridClock initialized: now 1790347800532443 us; error 30 us; skew 500 ppm
I20260925 14:50:00.533612 13865 webserver.cc:460] Webserver started at http://127.12.96.197:40621/ using document root <none> and password file <none>
I20260925 14:50:00.533806 13865 fs_manager.cc:359] Metadata directory not provided
I20260925 14:50:00.533852 13865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 14:50:00.533998 13865 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 14:50:00.534904 13865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "f58555a88f3741e8972f9babc9bbc46a"
format_stamp: "Formatted at 2026-09-25 14:50:00 on dist-test-slave-nsrc"
I20260925 14:50:00.535214 13865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "f58555a88f3741e8972f9babc9bbc46a"
format_stamp: "Formatted at 2026-09-25 14:50:00 on dist-test-slave-nsrc"
I20260925 14:50:00.536432 13865 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260925 14:50:00.537130 13879 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.537299 13865 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260925 14:50:00.537377 13865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "f58555a88f3741e8972f9babc9bbc46a"
format_stamp: "Formatted at 2026-09-25 14:50:00 on dist-test-slave-nsrc"
I20260925 14:50:00.537433 13865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 14:50:00.544375 13865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 14:50:00.544625 13865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 14:50:00.544737 13865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 14:50:00.544915 13865 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 14:50:00.545217 13865 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 14:50:00.545249 13865 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.545275 13865 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 14:50:00.545298 13865 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.551062 13865 rpc_server.cc:307] RPC server started. Bound to: 127.12.96.197:36415
I20260925 14:50:00.551121 13992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.96.197:36415 every 8 connection(s)
I20260925 14:50:00.551419 13865 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20260925 14:50:00.556583 13993 heartbeater.cc:347] Connected to a master server at 127.12.96.254:44023
I20260925 14:50:00.556668 13993 heartbeater.cc:464] Registering TS with master...
I20260925 14:50:00.556825 13993 heartbeater.cc:511] Master 127.12.96.254:44023 requested a full tablet report, sending...
I20260925 14:50:00.557137 13281 ts_manager.cc:194] Registered new tserver with Master: f58555a88f3741e8972f9babc9bbc46a (127.12.96.197:36415)
I20260925 14:50:00.557472 13281 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.96.197:57969
I20260925 14:50:00.559178 12675 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKe2EOk/build/release/bin/kudu as pid 13865
I20260925 14:50:00.559249 12675 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20260925 14:50:00.560106 12675 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKe2EOk/build/release/bin/kudu
/tmp/dist-test-taskKe2EOk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/wal
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/logs
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.96.198:0
--local_ip_for_outbound_sockets=127.12.96.198
--webserver_interface=127.12.96.198
--webserver_port=0
--tserver_master_addrs=127.12.96.254:44023
--builtin_ntp_servers=127.12.96.212:40653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=1000 with env {}
W20260925 14:50:00.639750 13996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 14:50:00.639997 13996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 14:50:00.640020 13996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 14:50:00.641187 13996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 14:50:00.641237 13996 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.96.198
I20260925 14:50:00.642516 13996 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.96.212:40653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=1000
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/data
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.96.198:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--webserver_interface=127.12.96.198
--webserver_port=0
--tserver_master_addrs=127.12.96.254:44023
--never_fsync=true
--heap_profile_path=/tmp/kudu.13996
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.96.198
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 25 Sep 2026 13:57:57 UTC on ccycloud.quasar-zfbtwj.root.comops.site
build id 4672727
I20260925 14:50:00.642697 13996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 14:50:00.642932 13996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 14:50:00.647790 14004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 14:50:00.647943 14002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 14:50:00.647822 14001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 14:50:00.648185 13996 server_base.cc:1034] running on GCE node
I20260925 14:50:00.648401 13996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 14:50:00.648694 13996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 14:50:00.649837 13996 hybrid_clock.cc:648] HybridClock initialized: now 1790347800649814 us; error 41 us; skew 500 ppm
I20260925 14:50:00.650969 13996 webserver.cc:460] Webserver started at http://127.12.96.198:42041/ using document root <none> and password file <none>
I20260925 14:50:00.651172 13996 fs_manager.cc:359] Metadata directory not provided
I20260925 14:50:00.651212 13996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 14:50:00.651307 13996 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 14:50:00.652738 13996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/data/instance:
uuid: "a85278aa3bfe45f1be717b3a18de2e8a"
format_stamp: "Formatted at 2026-09-25 14:50:00 on dist-test-slave-nsrc"
I20260925 14:50:00.653083 13996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/wal/instance:
uuid: "a85278aa3bfe45f1be717b3a18de2e8a"
format_stamp: "Formatted at 2026-09-25 14:50:00 on dist-test-slave-nsrc"
I20260925 14:50:00.654258 13996 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260925 14:50:00.654857 14010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.654982 13996 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.655057 13996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/data,/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/wal
uuid: "a85278aa3bfe45f1be717b3a18de2e8a"
format_stamp: "Formatted at 2026-09-25 14:50:00 on dist-test-slave-nsrc"
I20260925 14:50:00.655121 13996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/wal
metadata directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/wal
1 data directories: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 14:50:00.667925 13996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 14:50:00.668259 13996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 14:50:00.668385 13996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 14:50:00.668598 13996 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 14:50:00.668922 13996 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 14:50:00.668959 13996 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.668987 13996 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 14:50:00.669009 13996 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.674798 13996 rpc_server.cc:307] RPC server started. Bound to: 127.12.96.198:35925
I20260925 14:50:00.674862 14123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.96.198:35925 every 8 connection(s)
I20260925 14:50:00.675151 13996 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/data/info.pb
I20260925 14:50:00.680802 14124 heartbeater.cc:347] Connected to a master server at 127.12.96.254:44023
I20260925 14:50:00.680887 14124 heartbeater.cc:464] Registering TS with master...
I20260925 14:50:00.681063 14124 heartbeater.cc:511] Master 127.12.96.254:44023 requested a full tablet report, sending...
I20260925 14:50:00.681391 13281 ts_manager.cc:194] Registered new tserver with Master: a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925)
I20260925 14:50:00.681738 13281 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.96.198:43013
I20260925 14:50:00.684355 12675 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKe2EOk/build/release/bin/kudu as pid 13996
I20260925 14:50:00.684446 12675 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/wal/instance
I20260925 14:50:00.685482 12675 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKe2EOk/build/release/bin/kudu
/tmp/dist-test-taskKe2EOk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-6/wal
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-6/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-6/logs
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.96.199:0
--local_ip_for_outbound_sockets=127.12.96.199
--webserver_interface=127.12.96.199
--webserver_port=0
--tserver_master_addrs=127.12.96.254:44023
--builtin_ntp_servers=127.12.96.212:40653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=1000 with env {}
W20260925 14:50:00.766129 14127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 14:50:00.766383 14127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 14:50:00.766404 14127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 14:50:00.767555 14127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 14:50:00.767603 14127 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.96.199
I20260925 14:50:00.768903 14127 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.96.212:40653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=1000
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-6/data
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-6/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.96.199:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--webserver_interface=127.12.96.199
--webserver_port=0
--tserver_master_addrs=127.12.96.254:44023
--never_fsync=true
--heap_profile_path=/tmp/kudu.14127
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.96.199
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-6/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 25 Sep 2026 13:57:57 UTC on ccycloud.quasar-zfbtwj.root.comops.site
build id 4672727
I20260925 14:50:00.769085 14127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 14:50:00.769339 14127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 14:50:00.773947 14133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 14:50:00.773977 14135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 14:50:00.774098 14132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 14:50:00.774098 14127 server_base.cc:1034] running on GCE node
I20260925 14:50:00.774377 14127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 14:50:00.774593 14127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 14:50:00.775738 14127 hybrid_clock.cc:648] HybridClock initialized: now 1790347800775725 us; error 24 us; skew 500 ppm
I20260925 14:50:00.776922 14127 webserver.cc:460] Webserver started at http://127.12.96.199:42215/ using document root <none> and password file <none>
I20260925 14:50:00.777123 14127 fs_manager.cc:359] Metadata directory not provided
I20260925 14:50:00.777168 14127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 14:50:00.777283 14127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 14:50:00.778308 14127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-6/data/instance:
uuid: "a6fe4312bf89420a80f740f43ae5b25c"
format_stamp: "Formatted at 2026-09-25 14:50:00 on dist-test-slave-nsrc"
I20260925 14:50:00.778636 14127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-6/wal/instance:
uuid: "a6fe4312bf89420a80f740f43ae5b25c"
format_stamp: "Formatted at 2026-09-25 14:50:00 on dist-test-slave-nsrc"
I20260925 14:50:00.779815 14127 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260925 14:50:00.780468 14141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.780601 14127 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.780678 14127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-6/data,/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-6/wal
uuid: "a6fe4312bf89420a80f740f43ae5b25c"
format_stamp: "Formatted at 2026-09-25 14:50:00 on dist-test-slave-nsrc"
I20260925 14:50:00.780735 14127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-6/wal
metadata directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-6/wal
1 data directories: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-6/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 14:50:00.808013 14127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 14:50:00.808344 14127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 14:50:00.808471 14127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 14:50:00.808699 14127 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 14:50:00.809022 14127 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 14:50:00.809054 14127 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.809083 14127 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 14:50:00.809099 14127 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:00.815325 14127 rpc_server.cc:307] RPC server started. Bound to: 127.12.96.199:43631
I20260925 14:50:00.815371 14254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.96.199:43631 every 8 connection(s)
I20260925 14:50:00.815703 14127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-6/data/info.pb
I20260925 14:50:00.820079 12675 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKe2EOk/build/release/bin/kudu as pid 14127
I20260925 14:50:00.820182 12675 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-6/wal/instance
I20260925 14:50:00.821324 14255 heartbeater.cc:347] Connected to a master server at 127.12.96.254:44023
I20260925 14:50:00.821409 14255 heartbeater.cc:464] Registering TS with master...
I20260925 14:50:00.821592 14255 heartbeater.cc:511] Master 127.12.96.254:44023 requested a full tablet report, sending...
I20260925 14:50:00.821905 13281 ts_manager.cc:194] Registered new tserver with Master: a6fe4312bf89420a80f740f43ae5b25c (127.12.96.199:43631)
I20260925 14:50:00.822273 13281 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.96.199:52121
I20260925 14:50:00.832134 12675 external_mini_cluster.cc:930] 7 TS(s) registered with all masters
I20260925 14:50:00.837881 13281 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55198:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 7
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
W20260925 14:50:00.839380 13281 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 8 tablet servers would be needed, 7 are available. Consider bringing up more tablet servers.
I20260925 14:50:00.847525 13927 tablet_service.cc:1467] Processing CreateTablet for tablet cdae0f54cf1e45a8b448ea0c6fb3f369 (DEFAULT_TABLE table=TestTable [id=11716a282ab1485cada4f0c54aa55eaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 14:50:00.847905 13927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdae0f54cf1e45a8b448ea0c6fb3f369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 14:50:00.849306 13403 tablet_service.cc:1467] Processing CreateTablet for tablet cdae0f54cf1e45a8b448ea0c6fb3f369 (DEFAULT_TABLE table=TestTable [id=11716a282ab1485cada4f0c54aa55eaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 14:50:00.849531 13534 tablet_service.cc:1467] Processing CreateTablet for tablet cdae0f54cf1e45a8b448ea0c6fb3f369 (DEFAULT_TABLE table=TestTable [id=11716a282ab1485cada4f0c54aa55eaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 14:50:00.849663 13403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdae0f54cf1e45a8b448ea0c6fb3f369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 14:50:00.849885 13534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdae0f54cf1e45a8b448ea0c6fb3f369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 14:50:00.852587 13796 tablet_service.cc:1467] Processing CreateTablet for tablet cdae0f54cf1e45a8b448ea0c6fb3f369 (DEFAULT_TABLE table=TestTable [id=11716a282ab1485cada4f0c54aa55eaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 14:50:00.852772 14280 tablet_bootstrap.cc:492] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a: Bootstrap starting.
I20260925 14:50:00.852902 13796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdae0f54cf1e45a8b448ea0c6fb3f369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 14:50:00.853024 14281 tablet_bootstrap.cc:492] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11: Bootstrap starting.
I20260925 14:50:00.852954 14058 tablet_service.cc:1467] Processing CreateTablet for tablet cdae0f54cf1e45a8b448ea0c6fb3f369 (DEFAULT_TABLE table=TestTable [id=11716a282ab1485cada4f0c54aa55eaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 14:50:00.853248 14058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdae0f54cf1e45a8b448ea0c6fb3f369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 14:50:00.853401 14280 tablet_bootstrap.cc:654] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a: Neither blocks nor log segments found. Creating new log.
I20260925 14:50:00.853631 14281 tablet_bootstrap.cc:654] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11: Neither blocks nor log segments found. Creating new log.
I20260925 14:50:00.853696 14280 log.cc:824] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a: Log is configured to *not* fsync() on all Append() calls
I20260925 14:50:00.854386 14281 log.cc:824] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11: Log is configured to *not* fsync() on all Append() calls
I20260925 14:50:00.855105 14281 tablet_bootstrap.cc:492] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11: No bootstrap required, opened a new log
I20260925 14:50:00.855162 14281 ts_tablet_manager.cc:1397] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260925 14:50:00.855633 14284 tablet_bootstrap.cc:492] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a: Bootstrap starting.
I20260925 14:50:00.856240 14284 tablet_bootstrap.cc:654] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a: Neither blocks nor log segments found. Creating new log.
I20260925 14:50:00.856516 14284 log.cc:824] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a: Log is configured to *not* fsync() on all Append() calls
I20260925 14:50:00.857604 14281 raft_consensus.cc:348] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:00.857820 14281 raft_consensus.cc:374] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 14:50:00.857856 14281 raft_consensus.cc:729] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 701c21bd0bd34d0e9e56f196738cbd11, State: Initialized, Role: FOLLOWER
I20260925 14:50:00.857983 14281 consensus_queue.cc:260] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:00.858038 13665 tablet_service.cc:1467] Processing CreateTablet for tablet cdae0f54cf1e45a8b448ea0c6fb3f369 (DEFAULT_TABLE table=TestTable [id=11716a282ab1485cada4f0c54aa55eaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 14:50:00.858260 14281 ts_tablet_manager.cc:1428] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260925 14:50:00.858361 13665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdae0f54cf1e45a8b448ea0c6fb3f369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 14:50:00.858371 13600 heartbeater.cc:503] Master 127.12.96.254:44023 was elected leader, sending a full tablet report...
I20260925 14:50:00.858735 14285 tablet_bootstrap.cc:492] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3: Bootstrap starting.
I20260925 14:50:00.859277 14286 tablet_bootstrap.cc:492] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a: Bootstrap starting.
I20260925 14:50:00.859313 14285 tablet_bootstrap.cc:654] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3: Neither blocks nor log segments found. Creating new log.
I20260925 14:50:00.859839 14286 tablet_bootstrap.cc:654] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a: Neither blocks nor log segments found. Creating new log.
I20260925 14:50:00.860638 14286 log.cc:824] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a: Log is configured to *not* fsync() on all Append() calls
I20260925 14:50:00.860669 14285 log.cc:824] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3: Log is configured to *not* fsync() on all Append() calls
I20260925 14:50:00.861320 14280 tablet_bootstrap.cc:492] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a: No bootstrap required, opened a new log
I20260925 14:50:00.861395 14280 ts_tablet_manager.cc:1397] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20260925 14:50:00.861501 14291 tablet_bootstrap.cc:492] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838: Bootstrap starting.
I20260925 14:50:00.861588 14286 tablet_bootstrap.cc:492] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a: No bootstrap required, opened a new log
I20260925 14:50:00.861657 14286 ts_tablet_manager.cc:1397] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260925 14:50:00.861872 14189 tablet_service.cc:1467] Processing CreateTablet for tablet cdae0f54cf1e45a8b448ea0c6fb3f369 (DEFAULT_TABLE table=TestTable [id=11716a282ab1485cada4f0c54aa55eaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 14:50:00.862176 14189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdae0f54cf1e45a8b448ea0c6fb3f369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 14:50:00.862324 14291 tablet_bootstrap.cc:654] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838: Neither blocks nor log segments found. Creating new log.
I20260925 14:50:00.862673 14291 log.cc:824] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838: Log is configured to *not* fsync() on all Append() calls
I20260925 14:50:00.863595 14280 raft_consensus.cc:348] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:00.863732 14280 raft_consensus.cc:374] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 14:50:00.863762 14280 raft_consensus.cc:729] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f58555a88f3741e8972f9babc9bbc46a, State: Initialized, Role: FOLLOWER
I20260925 14:50:00.863880 14280 consensus_queue.cc:260] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:00.864126 13993 heartbeater.cc:503] Master 127.12.96.254:44023 was elected leader, sending a full tablet report...
I20260925 14:50:00.864090 14286 raft_consensus.cc:348] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:00.864271 14286 raft_consensus.cc:374] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 14:50:00.864317 14286 raft_consensus.cc:729] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85278aa3bfe45f1be717b3a18de2e8a, State: Initialized, Role: FOLLOWER
I20260925 14:50:00.864457 14280 ts_tablet_manager.cc:1428] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260925 14:50:00.864610 14286 consensus_queue.cc:260] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:00.864871 14286 ts_tablet_manager.cc:1428] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260925 14:50:00.864995 14124 heartbeater.cc:503] Master 127.12.96.254:44023 was elected leader, sending a full tablet report...
I20260925 14:50:00.865358 14296 tablet_bootstrap.cc:492] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c: Bootstrap starting.
I20260925 14:50:00.865724 14284 tablet_bootstrap.cc:492] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a: No bootstrap required, opened a new log
I20260925 14:50:00.865796 14284 ts_tablet_manager.cc:1397] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.001s
I20260925 14:50:00.865940 14296 tablet_bootstrap.cc:654] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c: Neither blocks nor log segments found. Creating new log.
I20260925 14:50:00.866217 14296 log.cc:824] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c: Log is configured to *not* fsync() on all Append() calls
I20260925 14:50:00.866938 14296 tablet_bootstrap.cc:492] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c: No bootstrap required, opened a new log
I20260925 14:50:00.867000 14296 ts_tablet_manager.cc:1397] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260925 14:50:00.868269 14295 raft_consensus.cc:482] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 14:50:00.868341 14295 raft_consensus.cc:504] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:00.869283 14296 raft_consensus.cc:348] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:00.869448 14295 leader_election.cc:288] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee1b311890c4c16a344bbde7933c838 (127.12.96.195:44787), f58555a88f3741e8972f9babc9bbc46a (127.12.96.197:36415), 15f60cba26104c4b9ebb52818978c1d3 (127.12.96.193:34571), a6fe4312bf89420a80f740f43ae5b25c (127.12.96.199:43631), 701c21bd0bd34d0e9e56f196738cbd11 (127.12.96.194:37593), 96d28122a9b140369b9a9dd3a2432d6a (127.12.96.196:43999)
I20260925 14:50:00.869446 14296 raft_consensus.cc:374] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 14:50:00.869565 14296 raft_consensus.cc:729] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6fe4312bf89420a80f740f43ae5b25c, State: Initialized, Role: FOLLOWER
I20260925 14:50:00.869692 14296 consensus_queue.cc:260] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:00.869961 14296 ts_tablet_manager.cc:1428] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260925 14:50:00.870057 14255 heartbeater.cc:503] Master 127.12.96.254:44023 was elected leader, sending a full tablet report...
I20260925 14:50:00.870081 14285 tablet_bootstrap.cc:492] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3: No bootstrap required, opened a new log
I20260925 14:50:00.870146 14285 ts_tablet_manager.cc:1397] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.002s
I20260925 14:50:00.870165 14291 tablet_bootstrap.cc:492] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838: No bootstrap required, opened a new log
I20260925 14:50:00.870225 14291 ts_tablet_manager.cc:1397] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20260925 14:50:00.871937 14284 raft_consensus.cc:348] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:00.872098 14284 raft_consensus.cc:374] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 14:50:00.872128 14284 raft_consensus.cc:729] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96d28122a9b140369b9a9dd3a2432d6a, State: Initialized, Role: FOLLOWER
I20260925 14:50:00.872272 14284 consensus_queue.cc:260] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:00.872529 14284 ts_tablet_manager.cc:1428] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a: Time spent starting tablet: real 0.007s user 0.003s sys 0.001s
I20260925 14:50:00.872711 13862 heartbeater.cc:503] Master 127.12.96.254:44023 was elected leader, sending a full tablet report...
I20260925 14:50:00.872620 14285 raft_consensus.cc:348] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:00.872607 14291 raft_consensus.cc:348] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:00.872771 14285 raft_consensus.cc:374] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 14:50:00.872771 14291 raft_consensus.cc:374] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 14:50:00.872804 14291 raft_consensus.cc:729] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee1b311890c4c16a344bbde7933c838, State: Initialized, Role: FOLLOWER
I20260925 14:50:00.872804 14285 raft_consensus.cc:729] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f60cba26104c4b9ebb52818978c1d3, State: Initialized, Role: FOLLOWER
I20260925 14:50:00.872905 14291 consensus_queue.cc:260] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:00.873144 14291 ts_tablet_manager.cc:1428] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260925 14:50:00.873201 14285 consensus_queue.cc:260] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:00.873472 14285 ts_tablet_manager.cc:1428] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260925 14:50:00.873594 13731 heartbeater.cc:503] Master 127.12.96.254:44023 was elected leader, sending a full tablet report...
I20260925 14:50:00.873638 13469 heartbeater.cc:503] Master 127.12.96.254:44023 was elected leader, sending a full tablet report...
I20260925 14:50:00.875568 13947 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f58555a88f3741e8972f9babc9bbc46a" is_pre_election: true
I20260925 14:50:00.875746 13947 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a85278aa3bfe45f1be717b3a18de2e8a in term 0.
I20260925 14:50:00.876346 13554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "701c21bd0bd34d0e9e56f196738cbd11" is_pre_election: true
I20260925 14:50:00.876484 13554 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a85278aa3bfe45f1be717b3a18de2e8a in term 0.
I20260925 14:50:00.876652 13685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee1b311890c4c16a344bbde7933c838" is_pre_election: true
I20260925 14:50:00.876751 13685 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a85278aa3bfe45f1be717b3a18de2e8a in term 0.
I20260925 14:50:00.876997 14014 leader_election.cc:302] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 701c21bd0bd34d0e9e56f196738cbd11, a85278aa3bfe45f1be717b3a18de2e8a, bee1b311890c4c16a344bbde7933c838, f58555a88f3741e8972f9babc9bbc46a; no voters:
I20260925 14:50:00.877136 14295 raft_consensus.cc:2781] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 14:50:00.877187 14295 raft_consensus.cc:482] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 14:50:00.877213 14295 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 0 FOLLOWER]: Advancing to term 1
I20260925 14:50:00.878065 14295 raft_consensus.cc:504] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:00.878228 14295 leader_election.cc:288] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [CANDIDATE]: Term 1 election: Requested vote from peers bee1b311890c4c16a344bbde7933c838 (127.12.96.195:44787), f58555a88f3741e8972f9babc9bbc46a (127.12.96.197:36415), 15f60cba26104c4b9ebb52818978c1d3 (127.12.96.193:34571), a6fe4312bf89420a80f740f43ae5b25c (127.12.96.199:43631), 701c21bd0bd34d0e9e56f196738cbd11 (127.12.96.194:37593), 96d28122a9b140369b9a9dd3a2432d6a (127.12.96.196:43999)
I20260925 14:50:00.878484 13554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "701c21bd0bd34d0e9e56f196738cbd11"
I20260925 14:50:00.878569 13554 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 0 FOLLOWER]: Advancing to term 1
I20260925 14:50:00.879298 13554 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85278aa3bfe45f1be717b3a18de2e8a in term 1.
I20260925 14:50:00.879482 13947 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f58555a88f3741e8972f9babc9bbc46a"
I20260925 14:50:00.879575 13947 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 0 FOLLOWER]: Advancing to term 1
I20260925 14:50:00.879659 13422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f60cba26104c4b9ebb52818978c1d3"
I20260925 14:50:00.879757 13422 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260925 14:50:00.880362 13947 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85278aa3bfe45f1be717b3a18de2e8a in term 1.
I20260925 14:50:00.880515 13422 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85278aa3bfe45f1be717b3a18de2e8a in term 1.
I20260925 14:50:00.879664 13423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f60cba26104c4b9ebb52818978c1d3" is_pre_election: true
I20260925 14:50:00.880837 13423 raft_consensus.cc:2362] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a85278aa3bfe45f1be717b3a18de2e8a in term 1. Re-sending same reply.
I20260925 14:50:00.880798 14209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6fe4312bf89420a80f740f43ae5b25c" is_pre_election: true
I20260925 14:50:00.880869 13816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96d28122a9b140369b9a9dd3a2432d6a" is_pre_election: true
I20260925 14:50:00.880944 14209 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a85278aa3bfe45f1be717b3a18de2e8a in term 0.
I20260925 14:50:00.880990 13816 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a85278aa3bfe45f1be717b3a18de2e8a in term 0.
I20260925 14:50:00.880815 14208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6fe4312bf89420a80f740f43ae5b25c"
I20260925 14:50:00.880997 14013 leader_election.cc:302] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 15f60cba26104c4b9ebb52818978c1d3, 701c21bd0bd34d0e9e56f196738cbd11, a85278aa3bfe45f1be717b3a18de2e8a, f58555a88f3741e8972f9babc9bbc46a; no voters:
I20260925 14:50:00.881038 14208 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 0 FOLLOWER]: Advancing to term 1
I20260925 14:50:00.881110 13815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96d28122a9b140369b9a9dd3a2432d6a"
I20260925 14:50:00.881177 13815 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a [term 0 FOLLOWER]: Advancing to term 1
I20260925 14:50:00.881196 14295 raft_consensus.cc:2781] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 1 FOLLOWER]: Leader election won for term 1
I20260925 14:50:00.881247 14295 raft_consensus.cc:686] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 1 LEADER]: Becoming Leader. State: Replica: a85278aa3bfe45f1be717b3a18de2e8a, State: Running, Role: LEADER
I20260925 14:50:00.881330 14295 consensus_queue.cc:237] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:00.881770 14208 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85278aa3bfe45f1be717b3a18de2e8a in term 1.
I20260925 14:50:00.881942 13815 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85278aa3bfe45f1be717b3a18de2e8a in term 1.
I20260925 14:50:00.882122 13685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee1b311890c4c16a344bbde7933c838"
I20260925 14:50:00.882205 13685 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [term 0 FOLLOWER]: Advancing to term 1
I20260925 14:50:00.882345 13280 catalog_manager.cc:5495] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a reported cstate change: term changed from 0 to 1, leader changed from <none> to a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198). New cstate: current_term: 1 leader_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } health_report { overall_health: UNKNOWN } } }
I20260925 14:50:00.883018 13685 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85278aa3bfe45f1be717b3a18de2e8a in term 1.
I20260925 14:50:00.893540 12675 external_mini_cluster.cc:930] 7 TS(s) registered with all masters
I20260925 14:50:00.894059 12675 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 15f60cba26104c4b9ebb52818978c1d3 to finish bootstrapping
I20260925 14:50:00.897466 12675 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 701c21bd0bd34d0e9e56f196738cbd11 to finish bootstrapping
I20260925 14:50:00.900538 12675 ts_itest-base.cc:233] Waiting for 1 tablets on tserver bee1b311890c4c16a344bbde7933c838 to finish bootstrapping
I20260925 14:50:00.903442 12675 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 96d28122a9b140369b9a9dd3a2432d6a to finish bootstrapping
I20260925 14:50:00.906539 12675 ts_itest-base.cc:233] Waiting for 1 tablets on tserver f58555a88f3741e8972f9babc9bbc46a to finish bootstrapping
I20260925 14:50:00.909562 12675 ts_itest-base.cc:233] Waiting for 1 tablets on tserver a85278aa3bfe45f1be717b3a18de2e8a to finish bootstrapping
I20260925 14:50:00.912732 12675 ts_itest-base.cc:233] Waiting for 1 tablets on tserver a6fe4312bf89420a80f740f43ae5b25c to finish bootstrapping
I20260925 14:50:00.923184 13815 raft_consensus.cc:1261] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a [term 1 FOLLOWER]: Refusing update from remote peer a85278aa3bfe45f1be717b3a18de2e8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 14:50:00.923239 13554 raft_consensus.cc:1261] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 1 FOLLOWER]: Refusing update from remote peer a85278aa3bfe45f1be717b3a18de2e8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 14:50:00.923380 13947 raft_consensus.cc:1261] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 1 FOLLOWER]: Refusing update from remote peer a85278aa3bfe45f1be717b3a18de2e8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 14:50:00.923518 14208 raft_consensus.cc:1261] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 1 FOLLOWER]: Refusing update from remote peer a85278aa3bfe45f1be717b3a18de2e8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 14:50:00.923559 13685 raft_consensus.cc:1261] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [term 1 FOLLOWER]: Refusing update from remote peer a85278aa3bfe45f1be717b3a18de2e8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 14:50:00.923839 14295 consensus_queue.cc:1035] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 14:50:00.923934 13423 raft_consensus.cc:1261] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 1 FOLLOWER]: Refusing update from remote peer a85278aa3bfe45f1be717b3a18de2e8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 14:50:00.923971 14321 consensus_queue.cc:1035] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 14:50:00.924171 14295 consensus_queue.cc:1035] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 14:50:00.924265 14295 consensus_queue.cc:1035] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 14:50:00.924322 14295 consensus_queue.cc:1035] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 14:50:00.924381 14295 consensus_queue.cc:1035] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260925 14:50:00.926047 14125 tablet.cc:2369] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260925 14:50:00.928848 13601 tablet.cc:2369] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260925 14:50:00.930960 14325 mvcc.cc:205] Tried to move back new op lower bound from 7333264592578809856 to 7333264592410796032. Current Snapshot: MvccSnapshot[applied={T|T < 7333264592578809856}]
I20260925 14:50:00.931571 14330 mvcc.cc:205] Tried to move back new op lower bound from 7333264592583733248 to 7333264592410796032. Current Snapshot: MvccSnapshot[applied={T|T < 7333264592578809856}]
I20260925 14:50:00.933079 14323 mvcc.cc:205] Tried to move back new op lower bound from 7333264592593883136 to 7333264592410796032. Current Snapshot: MvccSnapshot[applied={T|T < 7333264592578809856}]
I20260925 14:50:00.933272 14322 mvcc.cc:205] Tried to move back new op lower bound from 7333264592593883136 to 7333264592410796032. Current Snapshot: MvccSnapshot[applied={T|T < 7333264592578809856}]
W20260925 14:50:00.934535 13863 tablet.cc:2369] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260925 14:50:00.937505 14324 mvcc.cc:205] Tried to move back new op lower bound from 7333264592581287936 to 7333264592410796032. Current Snapshot: MvccSnapshot[applied={T|T < 7333264592578809856}]
I20260925 14:50:00.946342 14332 mvcc.cc:205] Tried to move back new op lower bound from 7333264592583733248 to 7333264592410796032. Current Snapshot: MvccSnapshot[applied={T|T < 7333264592578809856}]
I20260925 14:50:01.769582 12675 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKe2EOk/build/release/bin/kudu with pid 13996
W20260925 14:50:01.774034 14259 meta_cache.cc:302] tablet cdae0f54cf1e45a8b448ea0c6fb3f369: replica a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925) has failed: Network error: recv got EOF from 127.12.96.198:35925 (error 108)
W20260925 14:50:01.775470 13751 connection.cc:441] server connection from 127.12.96.198:48111 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.12.96.198:48111 (request call id 144) could send its response
W20260925 14:50:01.779474 14144 connection.cc:441] server connection from 127.12.96.198:44079 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.12.96.198:44079 (request call id 250) could send its response
W20260925 14:50:01.779747 13490 connection.cc:441] server connection from 127.12.96.198:39889 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.12.96.198:39889 (request call id 261) could send its response
I20260925 14:50:01.780856 12675 test_util.cc:268] Using random seed: -725622156
I20260925 14:50:01.891940 12675 test_util.cc:268] Using random seed: -725511077
I20260925 14:50:02.095578 12675 test_util.cc:268] Using random seed: -725307438
I20260925 14:50:02.399078 12675 test_util.cc:268] Using random seed: -725003938
I20260925 14:50:02.802340 12675 test_util.cc:268] Using random seed: -724600678
I20260925 14:50:02.827741 14375 raft_consensus.cc:482] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a85278aa3bfe45f1be717b3a18de2e8a)
I20260925 14:50:02.827839 14375 raft_consensus.cc:504] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:02.828236 14375 leader_election.cc:288] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee1b311890c4c16a344bbde7933c838 (127.12.96.195:44787), f58555a88f3741e8972f9babc9bbc46a (127.12.96.197:36415), 15f60cba26104c4b9ebb52818978c1d3 (127.12.96.193:34571), a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925), 701c21bd0bd34d0e9e56f196738cbd11 (127.12.96.194:37593), 96d28122a9b140369b9a9dd3a2432d6a (127.12.96.196:43999)
W20260925 14:50:02.829196 14143 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.96.198:35925: connect: Connection refused (error 111)
W20260925 14:50:02.832366 14143 leader_election.cc:334] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925): Network error: Client connection negotiation failed: client connection to 127.12.96.198:35925: connect: Connection refused (error 111)
I20260925 14:50:02.832504 13422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a6fe4312bf89420a80f740f43ae5b25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 691 } } ignore_live_leader: false dest_uuid: "15f60cba26104c4b9ebb52818978c1d3" is_pre_election: true
I20260925 14:50:02.832551 13946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a6fe4312bf89420a80f740f43ae5b25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 691 } } ignore_live_leader: false dest_uuid: "f58555a88f3741e8972f9babc9bbc46a" is_pre_election: true
I20260925 14:50:02.833448 13552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a6fe4312bf89420a80f740f43ae5b25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 691 } } ignore_live_leader: false dest_uuid: "701c21bd0bd34d0e9e56f196738cbd11" is_pre_election: true
I20260925 14:50:02.833609 13816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a6fe4312bf89420a80f740f43ae5b25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 691 } } ignore_live_leader: false dest_uuid: "96d28122a9b140369b9a9dd3a2432d6a" is_pre_election: true
I20260925 14:50:02.833670 14143 leader_election.cc:302] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 7 voters: 1 yes votes; 4 no votes. yes voters: a6fe4312bf89420a80f740f43ae5b25c; no voters: 15f60cba26104c4b9ebb52818978c1d3, 701c21bd0bd34d0e9e56f196738cbd11, a85278aa3bfe45f1be717b3a18de2e8a, f58555a88f3741e8972f9babc9bbc46a
I20260925 14:50:02.833801 14375 raft_consensus.cc:2726] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 14:50:02.834350 13684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a6fe4312bf89420a80f740f43ae5b25c" candidate_term: 2 candidate_status { last_received { term: 1 index: 691 } } ignore_live_leader: false dest_uuid: "bee1b311890c4c16a344bbde7933c838" is_pre_election: true
I20260925 14:50:02.938093 14388 raft_consensus.cc:482] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a85278aa3bfe45f1be717b3a18de2e8a)
I20260925 14:50:02.938182 14388 raft_consensus.cc:504] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:02.938508 14388 leader_election.cc:288] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee1b311890c4c16a344bbde7933c838 (127.12.96.195:44787), f58555a88f3741e8972f9babc9bbc46a (127.12.96.197:36415), a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925), a6fe4312bf89420a80f740f43ae5b25c (127.12.96.199:43631), 701c21bd0bd34d0e9e56f196738cbd11 (127.12.96.194:37593), 96d28122a9b140369b9a9dd3a2432d6a (127.12.96.196:43999)
W20260925 14:50:02.938936 13357 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.96.198:35925: connect: Connection refused (error 111)
I20260925 14:50:02.942687 13946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "15f60cba26104c4b9ebb52818978c1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 947 } } ignore_live_leader: false dest_uuid: "f58555a88f3741e8972f9babc9bbc46a" is_pre_election: true
I20260925 14:50:02.942811 13946 raft_consensus.cc:2396] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 15f60cba26104c4b9ebb52818978c1d3 for term 2 because replica has last-logged OpId of term: 1 index: 953, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 947.
I20260925 14:50:02.942866 14397 raft_consensus.cc:482] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a85278aa3bfe45f1be717b3a18de2e8a)
W20260925 14:50:02.942862 13357 leader_election.cc:334] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925): Network error: Client connection negotiation failed: client connection to 127.12.96.198:35925: connect: Connection refused (error 111)
I20260925 14:50:02.942907 14397 raft_consensus.cc:504] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:02.943054 14398 raft_consensus.cc:482] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a85278aa3bfe45f1be717b3a18de2e8a)
I20260925 14:50:02.943109 14398 raft_consensus.cc:504] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:02.943149 13684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "15f60cba26104c4b9ebb52818978c1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 947 } } ignore_live_leader: false dest_uuid: "bee1b311890c4c16a344bbde7933c838" is_pre_election: true
I20260925 14:50:02.943200 13816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "15f60cba26104c4b9ebb52818978c1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 947 } } ignore_live_leader: false dest_uuid: "96d28122a9b140369b9a9dd3a2432d6a" is_pre_election: true
I20260925 14:50:02.943320 13684 raft_consensus.cc:2396] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 15f60cba26104c4b9ebb52818978c1d3 for term 2 because replica has last-logged OpId of term: 1 index: 953, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 947.
I20260925 14:50:02.943593 14398 leader_election.cc:288] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f58555a88f3741e8972f9babc9bbc46a (127.12.96.197:36415), 15f60cba26104c4b9ebb52818978c1d3 (127.12.96.193:34571), a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925), a6fe4312bf89420a80f740f43ae5b25c (127.12.96.199:43631), 701c21bd0bd34d0e9e56f196738cbd11 (127.12.96.194:37593), 96d28122a9b140369b9a9dd3a2432d6a (127.12.96.196:43999)
I20260925 14:50:02.943611 13359 leader_election.cc:302] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 7 voters: 1 yes votes; 4 no votes. yes voters: 15f60cba26104c4b9ebb52818978c1d3; no voters: 96d28122a9b140369b9a9dd3a2432d6a, a85278aa3bfe45f1be717b3a18de2e8a, bee1b311890c4c16a344bbde7933c838, f58555a88f3741e8972f9babc9bbc46a
I20260925 14:50:02.943750 14388 raft_consensus.cc:2726] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 14:50:02.944450 13619 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.96.198:35925: connect: Connection refused (error 111)
I20260925 14:50:02.944758 13552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "15f60cba26104c4b9ebb52818978c1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 947 } } ignore_live_leader: false dest_uuid: "701c21bd0bd34d0e9e56f196738cbd11" is_pre_election: true
I20260925 14:50:02.945837 14397 leader_election.cc:288] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee1b311890c4c16a344bbde7933c838 (127.12.96.195:44787), 15f60cba26104c4b9ebb52818978c1d3 (127.12.96.193:34571), a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925), a6fe4312bf89420a80f740f43ae5b25c (127.12.96.199:43631), 701c21bd0bd34d0e9e56f196738cbd11 (127.12.96.194:37593), 96d28122a9b140369b9a9dd3a2432d6a (127.12.96.196:43999)
W20260925 14:50:02.946697 13881 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.96.198:35925: connect: Connection refused (error 111)
I20260925 14:50:02.947806 14208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "15f60cba26104c4b9ebb52818978c1d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 947 } } ignore_live_leader: false dest_uuid: "a6fe4312bf89420a80f740f43ae5b25c" is_pre_election: true
I20260925 14:50:02.947904 14208 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15f60cba26104c4b9ebb52818978c1d3 in term 1.
I20260925 14:50:02.947988 13684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "f58555a88f3741e8972f9babc9bbc46a" candidate_term: 2 candidate_status { last_received { term: 1 index: 953 } } ignore_live_leader: false dest_uuid: "bee1b311890c4c16a344bbde7933c838" is_pre_election: true
I20260925 14:50:02.948074 13684 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f58555a88f3741e8972f9babc9bbc46a in term 1.
I20260925 14:50:02.949020 13552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "bee1b311890c4c16a344bbde7933c838" candidate_term: 2 candidate_status { last_received { term: 1 index: 953 } } ignore_live_leader: false dest_uuid: "701c21bd0bd34d0e9e56f196738cbd11" is_pre_election: true
I20260925 14:50:02.951543 14208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "bee1b311890c4c16a344bbde7933c838" candidate_term: 2 candidate_status { last_received { term: 1 index: 953 } } ignore_live_leader: false dest_uuid: "a6fe4312bf89420a80f740f43ae5b25c" is_pre_election: true
I20260925 14:50:02.951628 14208 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee1b311890c4c16a344bbde7933c838 in term 1.
I20260925 14:50:02.952291 13816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "bee1b311890c4c16a344bbde7933c838" candidate_term: 2 candidate_status { last_received { term: 1 index: 953 } } ignore_live_leader: false dest_uuid: "96d28122a9b140369b9a9dd3a2432d6a" is_pre_election: true
I20260925 14:50:02.952630 13552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "f58555a88f3741e8972f9babc9bbc46a" candidate_term: 2 candidate_status { last_received { term: 1 index: 953 } } ignore_live_leader: false dest_uuid: "701c21bd0bd34d0e9e56f196738cbd11" is_pre_election: true
W20260925 14:50:02.952848 13619 leader_election.cc:334] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925): Network error: Client connection negotiation failed: client connection to 127.12.96.198:35925: connect: Connection refused (error 111)
W20260925 14:50:02.953097 13881 leader_election.cc:334] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925): Network error: Client connection negotiation failed: client connection to 127.12.96.198:35925: connect: Connection refused (error 111)
I20260925 14:50:02.953086 13422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "bee1b311890c4c16a344bbde7933c838" candidate_term: 2 candidate_status { last_received { term: 1 index: 953 } } ignore_live_leader: false dest_uuid: "15f60cba26104c4b9ebb52818978c1d3" is_pre_election: true
I20260925 14:50:02.953166 13422 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee1b311890c4c16a344bbde7933c838 in term 1.
I20260925 14:50:02.953238 13946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "bee1b311890c4c16a344bbde7933c838" candidate_term: 2 candidate_status { last_received { term: 1 index: 953 } } ignore_live_leader: false dest_uuid: "f58555a88f3741e8972f9babc9bbc46a" is_pre_election: true
I20260925 14:50:02.953321 13946 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee1b311890c4c16a344bbde7933c838 in term 1.
I20260925 14:50:02.953456 13620 leader_election.cc:302] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 7 responses out of 7 voters: 4 yes votes; 3 no votes. yes voters: 15f60cba26104c4b9ebb52818978c1d3, a6fe4312bf89420a80f740f43ae5b25c, bee1b311890c4c16a344bbde7933c838, f58555a88f3741e8972f9babc9bbc46a; no voters: 701c21bd0bd34d0e9e56f196738cbd11, 96d28122a9b140369b9a9dd3a2432d6a, a85278aa3bfe45f1be717b3a18de2e8a
I20260925 14:50:02.953634 14398 raft_consensus.cc:2781] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 14:50:02.953665 14398 raft_consensus.cc:482] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a85278aa3bfe45f1be717b3a18de2e8a)
I20260925 14:50:02.953683 14398 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [term 1 FOLLOWER]: Advancing to term 2
I20260925 14:50:02.954174 14208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "f58555a88f3741e8972f9babc9bbc46a" candidate_term: 2 candidate_status { last_received { term: 1 index: 953 } } ignore_live_leader: false dest_uuid: "a6fe4312bf89420a80f740f43ae5b25c" is_pre_election: true
I20260925 14:50:02.954250 14208 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f58555a88f3741e8972f9babc9bbc46a in term 1.
I20260925 14:50:02.954517 14398 raft_consensus.cc:504] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:02.954682 14398 leader_election.cc:288] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [CANDIDATE]: Term 2 election: Requested vote from peers f58555a88f3741e8972f9babc9bbc46a (127.12.96.197:36415), 15f60cba26104c4b9ebb52818978c1d3 (127.12.96.193:34571), a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925), a6fe4312bf89420a80f740f43ae5b25c (127.12.96.199:43631), 701c21bd0bd34d0e9e56f196738cbd11 (127.12.96.194:37593), 96d28122a9b140369b9a9dd3a2432d6a (127.12.96.196:43999)
I20260925 14:50:02.954701 13816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "f58555a88f3741e8972f9babc9bbc46a" candidate_term: 2 candidate_status { last_received { term: 1 index: 953 } } ignore_live_leader: false dest_uuid: "96d28122a9b140369b9a9dd3a2432d6a" is_pre_election: true
I20260925 14:50:02.954846 13816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "bee1b311890c4c16a344bbde7933c838" candidate_term: 2 candidate_status { last_received { term: 1 index: 953 } } ignore_live_leader: false dest_uuid: "96d28122a9b140369b9a9dd3a2432d6a"
I20260925 14:50:02.954895 13552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "bee1b311890c4c16a344bbde7933c838" candidate_term: 2 candidate_status { last_received { term: 1 index: 953 } } ignore_live_leader: false dest_uuid: "701c21bd0bd34d0e9e56f196738cbd11"
I20260925 14:50:02.955013 13422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "bee1b311890c4c16a344bbde7933c838" candidate_term: 2 candidate_status { last_received { term: 1 index: 953 } } ignore_live_leader: false dest_uuid: "15f60cba26104c4b9ebb52818978c1d3"
I20260925 14:50:02.955090 13422 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 1 FOLLOWER]: Advancing to term 2
I20260925 14:50:02.955060 14208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "bee1b311890c4c16a344bbde7933c838" candidate_term: 2 candidate_status { last_received { term: 1 index: 953 } } ignore_live_leader: false dest_uuid: "a6fe4312bf89420a80f740f43ae5b25c"
I20260925 14:50:02.955119 14208 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 1 FOLLOWER]: Advancing to term 2
I20260925 14:50:02.955109 13946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "bee1b311890c4c16a344bbde7933c838" candidate_term: 2 candidate_status { last_received { term: 1 index: 953 } } ignore_live_leader: false dest_uuid: "f58555a88f3741e8972f9babc9bbc46a"
I20260925 14:50:02.955163 13946 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 1 FOLLOWER]: Advancing to term 2
I20260925 14:50:02.955827 13946 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee1b311890c4c16a344bbde7933c838 in term 2.
I20260925 14:50:02.955826 14208 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee1b311890c4c16a344bbde7933c838 in term 2.
I20260925 14:50:02.955863 13422 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee1b311890c4c16a344bbde7933c838 in term 2.
I20260925 14:50:02.956166 13422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "f58555a88f3741e8972f9babc9bbc46a" candidate_term: 2 candidate_status { last_received { term: 1 index: 953 } } ignore_live_leader: false dest_uuid: "15f60cba26104c4b9ebb52818978c1d3" is_pre_election: true
I20260925 14:50:02.956209 13620 leader_election.cc:302] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 6 responses out of 7 voters: 4 yes votes; 2 no votes. yes voters: 15f60cba26104c4b9ebb52818978c1d3, a6fe4312bf89420a80f740f43ae5b25c, bee1b311890c4c16a344bbde7933c838, f58555a88f3741e8972f9babc9bbc46a; no voters: 701c21bd0bd34d0e9e56f196738cbd11, 96d28122a9b140369b9a9dd3a2432d6a
I20260925 14:50:02.956243 13422 raft_consensus.cc:2379] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f58555a88f3741e8972f9babc9bbc46a in current term 2: Already voted for candidate bee1b311890c4c16a344bbde7933c838 in this term.
I20260925 14:50:02.956302 14398 raft_consensus.cc:2781] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [term 2 FOLLOWER]: Leader election won for term 2
W20260925 14:50:02.956323 13619 leader_election.cc:334] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925): Network error: Client connection negotiation failed: client connection to 127.12.96.198:35925: connect: Connection refused (error 111)
I20260925 14:50:02.956373 13882 leader_election.cc:302] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 7 responses out of 7 voters: 3 yes votes; 4 no votes. yes voters: a6fe4312bf89420a80f740f43ae5b25c, bee1b311890c4c16a344bbde7933c838, f58555a88f3741e8972f9babc9bbc46a; no voters: 15f60cba26104c4b9ebb52818978c1d3, 701c21bd0bd34d0e9e56f196738cbd11, 96d28122a9b140369b9a9dd3a2432d6a, a85278aa3bfe45f1be717b3a18de2e8a
I20260925 14:50:02.956440 14398 raft_consensus.cc:686] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [term 2 LEADER]: Becoming Leader. State: Replica: bee1b311890c4c16a344bbde7933c838, State: Running, Role: LEADER
I20260925 14:50:02.956504 14397 raft_consensus.cc:2726] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 14:50:02.956547 14398 consensus_queue.cc:237] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 945, Committed index: 945, Last appended: 1.953, Last appended by leader: 953, Current term: 2, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:02.957226 13279 catalog_manager.cc:5495] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 reported cstate change: term changed from 1 to 2, leader changed from a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198) to bee1b311890c4c16a344bbde7933c838 (127.12.96.195). New cstate: current_term: 2 leader_uuid: "bee1b311890c4c16a344bbde7933c838" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } health_report { overall_health: UNKNOWN } } }
I20260925 14:50:03.275996 14424 raft_consensus.cc:482] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a85278aa3bfe45f1be717b3a18de2e8a)
I20260925 14:50:03.276129 14424 raft_consensus.cc:504] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:03.276531 14424 leader_election.cc:288] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee1b311890c4c16a344bbde7933c838 (127.12.96.195:44787), f58555a88f3741e8972f9babc9bbc46a (127.12.96.197:36415), 15f60cba26104c4b9ebb52818978c1d3 (127.12.96.193:34571), a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925), a6fe4312bf89420a80f740f43ae5b25c (127.12.96.199:43631), 701c21bd0bd34d0e9e56f196738cbd11 (127.12.96.194:37593)
W20260925 14:50:03.276996 13750 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.96.198:35925: connect: Connection refused (error 111)
W20260925 14:50:03.279071 13750 leader_election.cc:334] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925): Network error: Client connection negotiation failed: client connection to 127.12.96.198:35925: connect: Connection refused (error 111)
I20260925 14:50:03.280639 14432 raft_consensus.cc:482] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a85278aa3bfe45f1be717b3a18de2e8a)
I20260925 14:50:03.280736 14432 raft_consensus.cc:504] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:03.281618 13946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "96d28122a9b140369b9a9dd3a2432d6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 260 } } ignore_live_leader: false dest_uuid: "f58555a88f3741e8972f9babc9bbc46a" is_pre_election: true
I20260925 14:50:03.281728 13946 raft_consensus.cc:2379] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96d28122a9b140369b9a9dd3a2432d6a in current term 2: Already voted for candidate bee1b311890c4c16a344bbde7933c838 in this term.
I20260925 14:50:03.282332 14432 leader_election.cc:288] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee1b311890c4c16a344bbde7933c838 (127.12.96.195:44787), f58555a88f3741e8972f9babc9bbc46a (127.12.96.197:36415), 15f60cba26104c4b9ebb52818978c1d3 (127.12.96.193:34571), a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925), a6fe4312bf89420a80f740f43ae5b25c (127.12.96.199:43631), 96d28122a9b140369b9a9dd3a2432d6a (127.12.96.196:43999)
I20260925 14:50:03.282374 13552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "96d28122a9b140369b9a9dd3a2432d6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 260 } } ignore_live_leader: false dest_uuid: "701c21bd0bd34d0e9e56f196738cbd11" is_pre_election: true
I20260925 14:50:03.282480 13552 raft_consensus.cc:2396] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96d28122a9b140369b9a9dd3a2432d6a for term 2 because replica has last-logged OpId of term: 1 index: 461, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 260.
I20260925 14:50:03.282572 13684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "96d28122a9b140369b9a9dd3a2432d6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 260 } } ignore_live_leader: false dest_uuid: "bee1b311890c4c16a344bbde7933c838" is_pre_election: true
I20260925 14:50:03.282851 13750 leader_election.cc:302] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 7 voters: 1 yes votes; 4 no votes. yes voters: 96d28122a9b140369b9a9dd3a2432d6a; no voters: 701c21bd0bd34d0e9e56f196738cbd11, a85278aa3bfe45f1be717b3a18de2e8a, bee1b311890c4c16a344bbde7933c838, f58555a88f3741e8972f9babc9bbc46a
I20260925 14:50:03.282876 14208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "96d28122a9b140369b9a9dd3a2432d6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 260 } } ignore_live_leader: false dest_uuid: "a6fe4312bf89420a80f740f43ae5b25c" is_pre_election: true
I20260925 14:50:03.282961 14424 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a [term 1 FOLLOWER]: Advancing to term 2
I20260925 14:50:03.282972 14208 raft_consensus.cc:2379] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96d28122a9b140369b9a9dd3a2432d6a in current term 2: Already voted for candidate bee1b311890c4c16a344bbde7933c838 in this term.
I20260925 14:50:03.283670 13422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "96d28122a9b140369b9a9dd3a2432d6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 260 } } ignore_live_leader: false dest_uuid: "15f60cba26104c4b9ebb52818978c1d3" is_pre_election: true
I20260925 14:50:03.283763 13422 raft_consensus.cc:2379] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96d28122a9b140369b9a9dd3a2432d6a in current term 2: Already voted for candidate bee1b311890c4c16a344bbde7933c838 in this term.
I20260925 14:50:03.283793 14424 raft_consensus.cc:2726] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 14:50:03.284261 13488 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.96.198:35925: connect: Connection refused (error 111)
I20260925 14:50:03.285225 13684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "701c21bd0bd34d0e9e56f196738cbd11" candidate_term: 2 candidate_status { last_received { term: 1 index: 461 } } ignore_live_leader: false dest_uuid: "bee1b311890c4c16a344bbde7933c838" is_pre_election: true
I20260925 14:50:03.286847 13946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "701c21bd0bd34d0e9e56f196738cbd11" candidate_term: 2 candidate_status { last_received { term: 1 index: 461 } } ignore_live_leader: false dest_uuid: "f58555a88f3741e8972f9babc9bbc46a" is_pre_election: true
I20260925 14:50:03.286934 13946 raft_consensus.cc:2379] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 701c21bd0bd34d0e9e56f196738cbd11 in current term 2: Already voted for candidate bee1b311890c4c16a344bbde7933c838 in this term.
W20260925 14:50:03.287174 13488 leader_election.cc:334] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925): Network error: Client connection negotiation failed: client connection to 127.12.96.198:35925: connect: Connection refused (error 111)
I20260925 14:50:03.287642 13422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "701c21bd0bd34d0e9e56f196738cbd11" candidate_term: 2 candidate_status { last_received { term: 1 index: 461 } } ignore_live_leader: false dest_uuid: "15f60cba26104c4b9ebb52818978c1d3" is_pre_election: true
I20260925 14:50:03.287727 13422 raft_consensus.cc:2379] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 701c21bd0bd34d0e9e56f196738cbd11 in current term 2: Already voted for candidate bee1b311890c4c16a344bbde7933c838 in this term.
I20260925 14:50:03.287896 14208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "701c21bd0bd34d0e9e56f196738cbd11" candidate_term: 2 candidate_status { last_received { term: 1 index: 461 } } ignore_live_leader: false dest_uuid: "a6fe4312bf89420a80f740f43ae5b25c" is_pre_election: true
I20260925 14:50:03.287914 13489 leader_election.cc:302] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 7 voters: 1 yes votes; 4 no votes. yes voters: 701c21bd0bd34d0e9e56f196738cbd11; no voters: 15f60cba26104c4b9ebb52818978c1d3, a85278aa3bfe45f1be717b3a18de2e8a, bee1b311890c4c16a344bbde7933c838, f58555a88f3741e8972f9babc9bbc46a
I20260925 14:50:03.287983 14208 raft_consensus.cc:2379] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 701c21bd0bd34d0e9e56f196738cbd11 in current term 2: Already voted for candidate bee1b311890c4c16a344bbde7933c838 in this term.
I20260925 14:50:03.288059 14432 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 1 FOLLOWER]: Advancing to term 2
I20260925 14:50:03.288187 13816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "701c21bd0bd34d0e9e56f196738cbd11" candidate_term: 2 candidate_status { last_received { term: 1 index: 461 } } ignore_live_leader: false dest_uuid: "96d28122a9b140369b9a9dd3a2432d6a" is_pre_election: true
I20260925 14:50:03.288261 13816 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 701c21bd0bd34d0e9e56f196738cbd11 in term 2.
I20260925 14:50:03.288794 14432 raft_consensus.cc:2726] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 14:50:03.305897 12675 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKe2EOk/build/release/bin/kudu
/tmp/dist-test-taskKe2EOk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/wal
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/logs
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.96.198:35925
--local_ip_for_outbound_sockets=127.12.96.198
--tserver_master_addrs=127.12.96.254:44023
--webserver_port=42041
--webserver_interface=127.12.96.198
--builtin_ntp_servers=127.12.96.212:40653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=1000 with env {}
I20260925 14:50:03.341495 13946 raft_consensus.cc:1261] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 2 FOLLOWER]: Refusing update from remote peer bee1b311890c4c16a344bbde7933c838: Log matching property violated. Preceding OpId in replica: term: 1 index: 953. Preceding OpId from leader: term: 2 index: 954. (index mismatch)
I20260925 14:50:03.341739 14398 consensus_queue.cc:1035] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 954, Last known committed idx: 945, Time since last communication: 0.000s
I20260925 14:50:03.342686 14208 raft_consensus.cc:1261] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 2 FOLLOWER]: Refusing update from remote peer bee1b311890c4c16a344bbde7933c838: Log matching property violated. Preceding OpId in replica: term: 1 index: 691. Preceding OpId from leader: term: 2 index: 954. (index mismatch)
I20260925 14:50:03.342902 14398 consensus_queue.cc:1035] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 954, Last known committed idx: 684, Time since last communication: 0.000s
I20260925 14:50:03.355049 13552 raft_consensus.cc:1261] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 2 FOLLOWER]: Refusing update from remote peer bee1b311890c4c16a344bbde7933c838: Log matching property violated. Preceding OpId in replica: term: 1 index: 461. Preceding OpId from leader: term: 2 index: 954. (index mismatch)
I20260925 14:50:03.355280 14398 consensus_queue.cc:1035] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 954, Last known committed idx: 456, Time since last communication: 0.000s
I20260925 14:50:03.367548 13816 raft_consensus.cc:1261] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a [term 2 FOLLOWER]: Refusing update from remote peer bee1b311890c4c16a344bbde7933c838: Log matching property violated. Preceding OpId in replica: term: 1 index: 260. Preceding OpId from leader: term: 2 index: 954. (index mismatch)
I20260925 14:50:03.367817 14398 consensus_queue.cc:1035] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 954, Last known committed idx: 260, Time since last communication: 0.000s
I20260925 14:50:03.378482 13422 raft_consensus.cc:1261] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 2 FOLLOWER]: Refusing update from remote peer bee1b311890c4c16a344bbde7933c838: Log matching property violated. Preceding OpId in replica: term: 1 index: 947. Preceding OpId from leader: term: 2 index: 954. (index mismatch)
W20260925 14:50:03.379104 13619 consensus_peers.cc:487] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 -> Peer a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925): Couldn't send request to peer a85278aa3bfe45f1be717b3a18de2e8a. Status: Network error: Client connection negotiation failed: client connection to 127.12.96.198:35925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 14:50:03.379451 14418 consensus_queue.cc:1035] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 954, Last known committed idx: 942, Time since last communication: 0.000s
I20260925 14:50:03.384830 14457 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40230 (ReqId={client: ce4246662b7945ca8edc7bdb65555c22, seq_no=943, attempt_no=1}) took 1601 ms. Trace:
I20260925 14:50:03.385540 14457 rpcz_store.cc:276] 0925 14:50:01.783517 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 14:50:01.783521 (+ 4us) service_pool.cc:227] Handling call
0925 14:50:03.384821 (+1601300us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 14:50:03.385288 14458 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40230 (ReqId={client: ce4246662b7945ca8edc7bdb65555c22, seq_no=945, attempt_no=1}) took 1601 ms. Trace:
I20260925 14:50:03.385973 14458 rpcz_store.cc:276] 0925 14:50:01.783484 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 14:50:01.783525 (+ 41us) service_pool.cc:227] Handling call
0925 14:50:03.385072 (+1601547us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 14:50:03.385439 14459 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40230 (ReqId={client: ce4246662b7945ca8edc7bdb65555c22, seq_no=946, attempt_no=1}) took 1602 ms. Trace:
I20260925 14:50:03.386204 14459 rpcz_store.cc:276] 0925 14:50:01.783448 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 14:50:01.783480 (+ 32us) service_pool.cc:227] Handling call
0925 14:50:03.385435 (+1601955us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 14:50:03.385512 14460 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40230 (ReqId={client: ce4246662b7945ca8edc7bdb65555c22, seq_no=948, attempt_no=1}) took 1601 ms. Trace:
I20260925 14:50:03.386564 14460 rpcz_store.cc:276] 0925 14:50:01.783573 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 14:50:01.783584 (+ 11us) service_pool.cc:227] Handling call
0925 14:50:03.385510 (+1601926us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 14:50:03.386876 14459 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40230 (ReqId={client: ce4246662b7945ca8edc7bdb65555c22, seq_no=949, attempt_no=1}) took 1603 ms. Trace:
I20260925 14:50:03.387141 14459 rpcz_store.cc:276] 0925 14:50:01.783617 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 14:50:01.783633 (+ 16us) service_pool.cc:227] Handling call
0925 14:50:03.386873 (+1603240us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 14:50:03.387106 14460 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40230 (ReqId={client: ce4246662b7945ca8edc7bdb65555c22, seq_no=950, attempt_no=1}) took 1603 ms. Trace:
I20260925 14:50:03.387341 14460 rpcz_store.cc:276] 0925 14:50:01.783527 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 14:50:01.783639 (+ 112us) service_pool.cc:227] Handling call
0925 14:50:03.387105 (+1603466us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 14:50:03.387239 14457 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40230 (ReqId={client: ce4246662b7945ca8edc7bdb65555c22, seq_no=951, attempt_no=1}) took 1603 ms. Trace:
I20260925 14:50:03.387496 14457 rpcz_store.cc:276] 0925 14:50:01.783603 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 14:50:01.783614 (+ 11us) service_pool.cc:227] Handling call
0925 14:50:03.387237 (+1603623us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 14:50:03.386968 14458 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40230 (ReqId={client: ce4246662b7945ca8edc7bdb65555c22, seq_no=947, attempt_no=1}) took 1603 ms. Trace:
I20260925 14:50:03.387645 14458 rpcz_store.cc:276] 0925 14:50:01.783550 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 14:50:01.783563 (+ 13us) service_pool.cc:227] Handling call
0925 14:50:03.386966 (+1603403us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 14:50:03.400329 14441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 14:50:03.400933 14441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 14:50:03.400997 14441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260925 14:50:03.402709 14441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260925 14:50:03.402810 14441 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.96.198
I20260925 14:50:03.406136 14441 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.96.212:40653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=1000
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/data
--fs_wal_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.96.198:35925
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--webserver_interface=127.12.96.198
--webserver_port=42041
--tserver_master_addrs=127.12.96.254:44023
--never_fsync=true
--heap_profile_path=/tmp/kudu.14441
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.96.198
--log_dir=/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 25 Sep 2026 13:57:57 UTC on ccycloud.quasar-zfbtwj.root.comops.site
build id 4672727
I20260925 14:50:03.406579 14441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 14:50:03.407769 14441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 14:50:03.414872 14483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 14:50:03.415208 14481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 14:50:03.415956 14441 server_base.cc:1034] running on GCE node
W20260925 14:50:03.422973 14480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 14:50:03.423596 14441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 14:50:03.423914 14441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 14:50:03.487807 14441 hybrid_clock.cc:648] HybridClock initialized: now 1790347803487783 us; error 47 us; skew 500 ppm
I20260925 14:50:03.495509 14441 webserver.cc:460] Webserver started at http://127.12.96.198:42041/ using document root <none> and password file <none>
I20260925 14:50:03.495807 14441 fs_manager.cc:359] Metadata directory not provided
I20260925 14:50:03.495887 14441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 14:50:03.498059 14441 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260925 14:50:03.499078 14501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 14:50:03.499384 14441 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260925 14:50:03.499475 14441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/data,/tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/wal
uuid: "a85278aa3bfe45f1be717b3a18de2e8a"
format_stamp: "Formatted at 2026-09-25 14:50:00 on dist-test-slave-nsrc"
I20260925 14:50:03.499898 14441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/wal
metadata directory: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/wal
1 data directories: /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 14:50:03.535902 14441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260925 14:50:03.536386 14441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 14:50:03.536638 14441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 14:50:03.536960 14441 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 14:50:03.537698 14508 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260925 14:50:03.539404 14441 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260925 14:50:03.539445 14441 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260925 14:50:03.539476 14441 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260925 14:50:03.540294 14441 ts_tablet_manager.cc:610] Registered 1 tablets
I20260925 14:50:03.540328 14441 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260925 14:50:03.547245 14441 rpc_server.cc:307] RPC server started. Bound to: 127.12.96.198:35925
I20260925 14:50:03.547693 14441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKe2EOk/test-tmp/raft_consensus-itest.2.RaftConsensusITest.MultiThreadedInsertWithFailovers.1790347797875039-12675-0/raft_consensus-itest-cluster/ts-5/data/info.pb
I20260925 14:50:03.548218 14508 tablet_bootstrap.cc:492] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a: Bootstrap starting.
I20260925 14:50:03.552853 14615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.96.198:35925 every 8 connection(s)
I20260925 14:50:03.557549 12675 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKe2EOk/build/release/bin/kudu as pid 14441
I20260925 14:50:03.575382 14616 heartbeater.cc:347] Connected to a master server at 127.12.96.254:44023
I20260925 14:50:03.575528 14616 heartbeater.cc:464] Registering TS with master...
I20260925 14:50:03.575742 14616 heartbeater.cc:511] Master 127.12.96.254:44023 requested a full tablet report, sending...
I20260925 14:50:03.576463 13279 ts_manager.cc:194] Re-registered known tserver with Master: a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925)
I20260925 14:50:03.576977 13279 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.96.198:35139
I20260925 14:50:03.584282 14508 log.cc:824] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a: Log is configured to *not* fsync() on all Append() calls
I20260925 14:50:03.686503 14508 tablet_bootstrap.cc:492] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a: Bootstrap replayed 1/1 log segments. Stats: ops{read=953 overwritten=0 applied=945 ignored=0} inserts{seen=9440 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 8 replicates
I20260925 14:50:03.687065 14508 tablet_bootstrap.cc:492] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a: Bootstrap complete.
I20260925 14:50:03.688230 14508 ts_tablet_manager.cc:1397] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a: Time spent bootstrapping tablet: real 0.140s user 0.091s sys 0.029s
I20260925 14:50:03.690455 14508 raft_consensus.cc:348] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 1 FOLLOWER]: Replica starting. Triggering 8 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:03.691625 14508 raft_consensus.cc:729] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85278aa3bfe45f1be717b3a18de2e8a, State: Initialized, Role: FOLLOWER
I20260925 14:50:03.691855 14508 consensus_queue.cc:260] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 945, Last appended: 1.953, Last appended by leader: 953, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:03.692193 14508 ts_tablet_manager.cc:1428] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260925 14:50:03.692361 14616 heartbeater.cc:503] Master 127.12.96.254:44023 was elected leader, sending a full tablet report...
I20260925 14:50:03.938822 14562 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 1 FOLLOWER]: Advancing to term 2
I20260925 14:50:03.955343 14623 mvcc.cc:205] Tried to move back new op lower bound from 7333264604623896576 to 7333264600910831616. Current Snapshot: MvccSnapshot[applied={T|T < 7333264602931286016 or (T in {7333264602931666944,7333264602936606720,7333264602946347008,7333264602946699264,7333264602946953216,7333264602947211264,7333264602947440640,7333264602947612672,7333264602947792896,7333264602947964928,7333264602961952768,7333264602964541440,7333264602966081536,7333264602967482368,7333264602968231936,7333264602968522752,7333264602968780800,7333264602969071616,7333264602982531072,7333264602983485440,7333264602983751680,7333264602983936000,7333264602984099840,7333264602984284160,7333264602984464384,7333264602984632320,7333264602995601408,7333264603005108224,7333264603006869504,7333264603007291392,7333264603007741952,7333264603009835008,7333264603011039232,7333264603011395584,7333264603014836224,7333264603019292672,7333264603023437824,7333264603023671296,7333264603023867904,7333264603024453632,7333264603026415616,7333264603026644992,7333264603026960384,7333264603045183488,7333264603049078784,7333264603051155456,7333264603055710208,7333264603062845440,7333264603067518976,7333264603067842560,7333264603068121088,7333264603068428288,7333264603068915712,7333264603070062592,7333264603070607360,7333264603079438336,7333264603079847936,7333264603080167424,7333264603080470528,7333264603080765440,7333264603094380544,7333264603094937600,7333264603095429120,7333264603095920640,7333264603096350720,7333264603096805376,7333264603097202688,7333264603123539968,7333264603127005184,7333264603128070144,7333264603097612288,7333264603128594432,7333264603128856576,7333264603132071936,7333264603132362752,7333264603133681664,7333264603133952000,7333264603138134016,7333264603141492736,7333264603141718016,7333264603144749056,7333264603160707072,7333264603162996736,7333264603164819456,7333264603165081600,7333264603165310976,7333264603165548544,7333264603166646272,7333264603167072256,7333264603183738880,7333264603186323456,7333264603191771136,7333264603192143872,7333264603192320000,7333264603192496128,7333264603192659968,7333264603192819712,7333264603197329408,7333264603200880640,7333264603207811072,7333264603209895936,7333264603211841536,7333264603216171008,7333264603218321408,7333264603221561344,7333264603227414528,7333264603230212096,7333264603233619968,7333264603241836544,7333264603247038464,7333264603249786880,7333264603250962432,7333264603252584448,7333264603253501952,7333264603253686272,7333264603254108160,7333264603258826752,7333264603259191296,7333264603267694592,7333264603267997696,7333264603270615040,7333264603274194944,7333264603276505088,7333264603284107264,7333264603283025920,7333264603291488256,7333264603293999104,7333264603299463168,7333264603302326272,7333264603305095168,7333264603308605440,7333264603313676288,7333264603330433024,7333264603331403776,7333264603334324224,7333264603336941568,7333264603339145216,7333264603341467648,7333264603341967360,7333264603348692992,7333264603364880384,7333264603370377216,7333264603374186496,7333264603374510080,7333264603374673920,7333264603374817280,7333264603374968832,7333264603375292416,7333264603380342784,7333264603399163904,7333264603401240576,7333264603401969664,7333264603402305536,7333264603402481664,7333264603402657792,7333264603402842112,7333264603403948032,7333264603409866752,7333264603411738624,7333264603418742784,7333264603418959872,7333264603421241344,7333264603423563776,7333264603441950720,7333264603447869440,7333264603450957824,7333264603451207680,7333264603451965440,7333264603452149760})}]
I20260925 14:50:04.425935 12675 test_util.cc:268] Using random seed: -722977084
I20260925 14:50:04.730121 12675 test_util.cc:268] Using random seed: -722672904
I20260925 14:50:05.134416 12675 test_util.cc:268] Using random seed: -722268602
I20260925 14:50:05.254990 14631 raft_consensus.cc:482] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee1b311890c4c16a344bbde7933c838)
I20260925 14:50:05.255100 14631 raft_consensus.cc:504] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:05.255326 14631 leader_election.cc:288] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee1b311890c4c16a344bbde7933c838 (127.12.96.195:44787), f58555a88f3741e8972f9babc9bbc46a (127.12.96.197:36415), 15f60cba26104c4b9ebb52818978c1d3 (127.12.96.193:34571), a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925), a6fe4312bf89420a80f740f43ae5b25c (127.12.96.199:43631), 96d28122a9b140369b9a9dd3a2432d6a (127.12.96.196:43999)
I20260925 14:50:05.255584 13816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "701c21bd0bd34d0e9e56f196738cbd11" candidate_term: 3 candidate_status { last_received { term: 2 index: 1494 } } ignore_live_leader: false dest_uuid: "96d28122a9b140369b9a9dd3a2432d6a" is_pre_election: true
I20260925 14:50:05.255578 14208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "701c21bd0bd34d0e9e56f196738cbd11" candidate_term: 3 candidate_status { last_received { term: 2 index: 1494 } } ignore_live_leader: false dest_uuid: "a6fe4312bf89420a80f740f43ae5b25c" is_pre_election: true
I20260925 14:50:05.255789 13946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "701c21bd0bd34d0e9e56f196738cbd11" candidate_term: 3 candidate_status { last_received { term: 2 index: 1494 } } ignore_live_leader: false dest_uuid: "f58555a88f3741e8972f9babc9bbc46a" is_pre_election: true
I20260925 14:50:05.255831 13422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "701c21bd0bd34d0e9e56f196738cbd11" candidate_term: 3 candidate_status { last_received { term: 2 index: 1494 } } ignore_live_leader: false dest_uuid: "15f60cba26104c4b9ebb52818978c1d3" is_pre_election: true
I20260925 14:50:05.255999 13489 leader_election.cc:302] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 7 voters: 1 yes votes; 4 no votes. yes voters: 701c21bd0bd34d0e9e56f196738cbd11; no voters: 15f60cba26104c4b9ebb52818978c1d3, 96d28122a9b140369b9a9dd3a2432d6a, a6fe4312bf89420a80f740f43ae5b25c, f58555a88f3741e8972f9babc9bbc46a
I20260925 14:50:05.256124 14631 raft_consensus.cc:2726] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 14:50:05.258381 14563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "701c21bd0bd34d0e9e56f196738cbd11" candidate_term: 3 candidate_status { last_received { term: 2 index: 1494 } } ignore_live_leader: false dest_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" is_pre_election: true
I20260925 14:50:05.365252 14634 raft_consensus.cc:482] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee1b311890c4c16a344bbde7933c838)
I20260925 14:50:05.365355 14634 raft_consensus.cc:504] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:05.365566 14634 leader_election.cc:288] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee1b311890c4c16a344bbde7933c838 (127.12.96.195:44787), f58555a88f3741e8972f9babc9bbc46a (127.12.96.197:36415), 15f60cba26104c4b9ebb52818978c1d3 (127.12.96.193:34571), a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925), 701c21bd0bd34d0e9e56f196738cbd11 (127.12.96.194:37593), 96d28122a9b140369b9a9dd3a2432d6a (127.12.96.196:43999)
I20260925 14:50:05.365820 13946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a6fe4312bf89420a80f740f43ae5b25c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1745 } } ignore_live_leader: false dest_uuid: "f58555a88f3741e8972f9babc9bbc46a" is_pre_election: true
I20260925 14:50:05.365820 13422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a6fe4312bf89420a80f740f43ae5b25c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1745 } } ignore_live_leader: false dest_uuid: "15f60cba26104c4b9ebb52818978c1d3" is_pre_election: true
I20260925 14:50:05.365861 13816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a6fe4312bf89420a80f740f43ae5b25c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1745 } } ignore_live_leader: false dest_uuid: "96d28122a9b140369b9a9dd3a2432d6a" is_pre_election: true
I20260925 14:50:05.365996 13553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a6fe4312bf89420a80f740f43ae5b25c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1745 } } ignore_live_leader: false dest_uuid: "701c21bd0bd34d0e9e56f196738cbd11" is_pre_election: true
I20260925 14:50:05.366078 13553 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6fe4312bf89420a80f740f43ae5b25c in term 2.
I20260925 14:50:05.368624 14563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a6fe4312bf89420a80f740f43ae5b25c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1745 } } ignore_live_leader: false dest_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" is_pre_election: true
I20260925 14:50:05.368840 14143 leader_election.cc:302] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 6 responses out of 7 voters: 2 yes votes; 4 no votes. yes voters: 701c21bd0bd34d0e9e56f196738cbd11, a6fe4312bf89420a80f740f43ae5b25c; no voters: 15f60cba26104c4b9ebb52818978c1d3, 96d28122a9b140369b9a9dd3a2432d6a, a85278aa3bfe45f1be717b3a18de2e8a, f58555a88f3741e8972f9babc9bbc46a
I20260925 14:50:05.368938 14634 raft_consensus.cc:2726] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 14:50:05.476414 14636 raft_consensus.cc:482] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee1b311890c4c16a344bbde7933c838)
I20260925 14:50:05.476549 14636 raft_consensus.cc:504] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:05.476964 14636 leader_election.cc:288] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee1b311890c4c16a344bbde7933c838 (127.12.96.195:44787), f58555a88f3741e8972f9babc9bbc46a (127.12.96.197:36415), 15f60cba26104c4b9ebb52818978c1d3 (127.12.96.193:34571), a6fe4312bf89420a80f740f43ae5b25c (127.12.96.199:43631), 701c21bd0bd34d0e9e56f196738cbd11 (127.12.96.194:37593), 96d28122a9b140369b9a9dd3a2432d6a (127.12.96.196:43999)
I20260925 14:50:05.477962 14647 raft_consensus.cc:482] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee1b311890c4c16a344bbde7933c838)
I20260925 14:50:05.478084 14647 raft_consensus.cc:504] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:05.478454 14647 leader_election.cc:288] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee1b311890c4c16a344bbde7933c838 (127.12.96.195:44787), 15f60cba26104c4b9ebb52818978c1d3 (127.12.96.193:34571), a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925), a6fe4312bf89420a80f740f43ae5b25c (127.12.96.199:43631), 701c21bd0bd34d0e9e56f196738cbd11 (127.12.96.194:37593), 96d28122a9b140369b9a9dd3a2432d6a (127.12.96.196:43999)
I20260925 14:50:05.478538 13816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "f58555a88f3741e8972f9babc9bbc46a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "96d28122a9b140369b9a9dd3a2432d6a" is_pre_election: true
I20260925 14:50:05.478788 13553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "f58555a88f3741e8972f9babc9bbc46a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "701c21bd0bd34d0e9e56f196738cbd11" is_pre_election: true
I20260925 14:50:05.478829 13422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "f58555a88f3741e8972f9babc9bbc46a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "15f60cba26104c4b9ebb52818978c1d3" is_pre_election: true
I20260925 14:50:05.478879 13553 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f58555a88f3741e8972f9babc9bbc46a in term 2.
I20260925 14:50:05.478917 13422 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f58555a88f3741e8972f9babc9bbc46a in term 2.
I20260925 14:50:05.478916 14208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "f58555a88f3741e8972f9babc9bbc46a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "a6fe4312bf89420a80f740f43ae5b25c" is_pre_election: true
I20260925 14:50:05.478988 14208 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f58555a88f3741e8972f9babc9bbc46a in term 2.
I20260925 14:50:05.479239 13881 leader_election.cc:302] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 5 responses out of 7 voters: 4 yes votes; 1 no votes. yes voters: 15f60cba26104c4b9ebb52818978c1d3, 701c21bd0bd34d0e9e56f196738cbd11, a6fe4312bf89420a80f740f43ae5b25c, f58555a88f3741e8972f9babc9bbc46a; no voters: 96d28122a9b140369b9a9dd3a2432d6a
I20260925 14:50:05.479379 14647 raft_consensus.cc:2781] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 14:50:05.479446 14647 raft_consensus.cc:482] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 2 FOLLOWER]: Starting leader election (detected failure of leader bee1b311890c4c16a344bbde7933c838)
I20260925 14:50:05.479516 14647 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 2 FOLLOWER]: Advancing to term 3
I20260925 14:50:05.480476 14647 raft_consensus.cc:504] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:05.480865 13422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "f58555a88f3741e8972f9babc9bbc46a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "15f60cba26104c4b9ebb52818978c1d3"
I20260925 14:50:05.480945 13422 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 2 FOLLOWER]: Advancing to term 3
I20260925 14:50:05.480978 14208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "f58555a88f3741e8972f9babc9bbc46a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "a6fe4312bf89420a80f740f43ae5b25c"
I20260925 14:50:05.481034 14208 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 2 FOLLOWER]: Advancing to term 3
I20260925 14:50:05.481667 13422 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f58555a88f3741e8972f9babc9bbc46a in term 3.
I20260925 14:50:05.481727 14208 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f58555a88f3741e8972f9babc9bbc46a in term 3.
I20260925 14:50:05.481778 14209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1784 } } ignore_live_leader: false dest_uuid: "a6fe4312bf89420a80f740f43ae5b25c" is_pre_election: true
I20260925 14:50:05.481868 14209 raft_consensus.cc:2379] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a85278aa3bfe45f1be717b3a18de2e8a in current term 3: Already voted for candidate f58555a88f3741e8972f9babc9bbc46a in this term.
I20260925 14:50:05.481914 13946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1784 } } ignore_live_leader: false dest_uuid: "f58555a88f3741e8972f9babc9bbc46a" is_pre_election: true
I20260925 14:50:05.481986 13946 raft_consensus.cc:2379] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a85278aa3bfe45f1be717b3a18de2e8a in current term 3: Already voted for candidate f58555a88f3741e8972f9babc9bbc46a in this term.
I20260925 14:50:05.482155 14647 leader_election.cc:288] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [CANDIDATE]: Term 3 election: Requested vote from peers bee1b311890c4c16a344bbde7933c838 (127.12.96.195:44787), 15f60cba26104c4b9ebb52818978c1d3 (127.12.96.193:34571), a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925), a6fe4312bf89420a80f740f43ae5b25c (127.12.96.199:43631), 701c21bd0bd34d0e9e56f196738cbd11 (127.12.96.194:37593), 96d28122a9b140369b9a9dd3a2432d6a (127.12.96.196:43999)
I20260925 14:50:05.482384 13816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "f58555a88f3741e8972f9babc9bbc46a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "96d28122a9b140369b9a9dd3a2432d6a"
I20260925 14:50:05.482645 13553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1784 } } ignore_live_leader: false dest_uuid: "701c21bd0bd34d0e9e56f196738cbd11" is_pre_election: true
I20260925 14:50:05.482746 13553 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a85278aa3bfe45f1be717b3a18de2e8a in term 2.
I20260925 14:50:05.482822 13552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "f58555a88f3741e8972f9babc9bbc46a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "701c21bd0bd34d0e9e56f196738cbd11"
I20260925 14:50:05.482865 13552 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 2 FOLLOWER]: Advancing to term 3
I20260925 14:50:05.482916 14649 raft_consensus.cc:482] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 14:50:05.482970 14649 raft_consensus.cc:504] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:05.483253 13946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "15f60cba26104c4b9ebb52818978c1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "f58555a88f3741e8972f9babc9bbc46a" is_pre_election: true
I20260925 14:50:05.483322 13946 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15f60cba26104c4b9ebb52818978c1d3 in term 3.
I20260925 14:50:05.483448 14649 leader_election.cc:288] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee1b311890c4c16a344bbde7933c838 (127.12.96.195:44787), f58555a88f3741e8972f9babc9bbc46a (127.12.96.197:36415), a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925), a6fe4312bf89420a80f740f43ae5b25c (127.12.96.199:43631), 701c21bd0bd34d0e9e56f196738cbd11 (127.12.96.194:37593), 96d28122a9b140369b9a9dd3a2432d6a (127.12.96.196:43999)
I20260925 14:50:05.483592 13552 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f58555a88f3741e8972f9babc9bbc46a in term 3.
I20260925 14:50:05.483579 14209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "15f60cba26104c4b9ebb52818978c1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "a6fe4312bf89420a80f740f43ae5b25c" is_pre_election: true
I20260925 14:50:05.483640 14209 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15f60cba26104c4b9ebb52818978c1d3 in term 3.
I20260925 14:50:05.483902 13552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "15f60cba26104c4b9ebb52818978c1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "701c21bd0bd34d0e9e56f196738cbd11" is_pre_election: true
I20260925 14:50:05.483973 13552 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15f60cba26104c4b9ebb52818978c1d3 in term 3.
I20260925 14:50:05.484081 13881 leader_election.cc:302] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 5 responses out of 7 voters: 4 yes votes; 1 no votes. yes voters: 15f60cba26104c4b9ebb52818978c1d3, 701c21bd0bd34d0e9e56f196738cbd11, a6fe4312bf89420a80f740f43ae5b25c, f58555a88f3741e8972f9babc9bbc46a; no voters: 96d28122a9b140369b9a9dd3a2432d6a
I20260925 14:50:05.484115 13816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "15f60cba26104c4b9ebb52818978c1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "96d28122a9b140369b9a9dd3a2432d6a" is_pre_election: true
I20260925 14:50:05.484179 14647 raft_consensus.cc:2781] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 3 FOLLOWER]: Leader election won for term 3
I20260925 14:50:05.484267 14647 raft_consensus.cc:686] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 3 LEADER]: Becoming Leader. State: Replica: f58555a88f3741e8972f9babc9bbc46a, State: Running, Role: LEADER
I20260925 14:50:05.484337 13357 leader_election.cc:302] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 5 responses out of 7 voters: 4 yes votes; 1 no votes. yes voters: 15f60cba26104c4b9ebb52818978c1d3, 701c21bd0bd34d0e9e56f196738cbd11, a6fe4312bf89420a80f740f43ae5b25c, f58555a88f3741e8972f9babc9bbc46a; no voters: 96d28122a9b140369b9a9dd3a2432d6a
I20260925 14:50:05.484355 14647 consensus_queue.cc:237] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1777, Committed index: 1777, Last appended: 2.1785, Last appended by leader: 1785, Current term: 3, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:05.485132 14649 raft_consensus.cc:2781] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 14:50:05.485118 13279 catalog_manager.cc:5495] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a reported cstate change: term changed from 2 to 3, leader changed from bee1b311890c4c16a344bbde7933c838 (127.12.96.195) to f58555a88f3741e8972f9babc9bbc46a (127.12.96.197). New cstate: current_term: 3 leader_uuid: "f58555a88f3741e8972f9babc9bbc46a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } health_report { overall_health: UNKNOWN } } }
I20260925 14:50:05.485263 14649 raft_consensus.cc:482] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 14:50:05.485289 14649 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 3 FOLLOWER]: Advancing to term 4
I20260925 14:50:05.485980 13422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1784 } } ignore_live_leader: false dest_uuid: "15f60cba26104c4b9ebb52818978c1d3" is_pre_election: true
I20260925 14:50:05.486137 14649 raft_consensus.cc:504] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:05.486241 13422 raft_consensus.cc:2354] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a85278aa3bfe45f1be717b3a18de2e8a for earlier term 3. Current term is 4.
I20260925 14:50:05.486498 14504 leader_election.cc:398] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [CANDIDATE]: Term 3 pre-election: Vote denied by peer 15f60cba26104c4b9ebb52818978c1d3 (127.12.96.193:34571) with higher term. Message: Invalid argument: T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a85278aa3bfe45f1be717b3a18de2e8a for earlier term 3. Current term is 4.
I20260925 14:50:05.486557 14504 leader_election.cc:401] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260925 14:50:05.486601 14209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "15f60cba26104c4b9ebb52818978c1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "a6fe4312bf89420a80f740f43ae5b25c"
I20260925 14:50:05.486647 14636 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 2 FOLLOWER]: Advancing to term 4
I20260925 14:50:05.486661 14209 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 3 FOLLOWER]: Advancing to term 4
I20260925 14:50:05.486676 13552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "15f60cba26104c4b9ebb52818978c1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "701c21bd0bd34d0e9e56f196738cbd11"
I20260925 14:50:05.486651 13816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "15f60cba26104c4b9ebb52818978c1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "96d28122a9b140369b9a9dd3a2432d6a"
I20260925 14:50:05.486730 13552 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 3 FOLLOWER]: Advancing to term 4
I20260925 14:50:05.486841 14649 leader_election.cc:288] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [CANDIDATE]: Term 4 election: Requested vote from peers bee1b311890c4c16a344bbde7933c838 (127.12.96.195:44787), f58555a88f3741e8972f9babc9bbc46a (127.12.96.197:36415), a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925), a6fe4312bf89420a80f740f43ae5b25c (127.12.96.199:43631), 701c21bd0bd34d0e9e56f196738cbd11 (127.12.96.194:37593), 96d28122a9b140369b9a9dd3a2432d6a (127.12.96.196:43999)
I20260925 14:50:05.487339 14636 raft_consensus.cc:2726] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 15f60cba26104c4b9ebb52818978c1d3 (127.12.96.193:34571) with higher term. Message: Invalid argument: T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a85278aa3bfe45f1be717b3a18de2e8a for earlier term 3. Current term is 4.
I20260925 14:50:05.487337 14209 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f60cba26104c4b9ebb52818978c1d3 in term 4.
I20260925 14:50:05.487412 13552 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f60cba26104c4b9ebb52818978c1d3 in term 4.
I20260925 14:50:05.487653 13946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "15f60cba26104c4b9ebb52818978c1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "f58555a88f3741e8972f9babc9bbc46a"
I20260925 14:50:05.487774 14562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "f58555a88f3741e8972f9babc9bbc46a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "a85278aa3bfe45f1be717b3a18de2e8a"
I20260925 14:50:05.487749 14563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "f58555a88f3741e8972f9babc9bbc46a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" is_pre_election: true
I20260925 14:50:05.487843 14562 raft_consensus.cc:2354] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f58555a88f3741e8972f9babc9bbc46a for earlier term 3. Current term is 4.
I20260925 14:50:05.487866 13816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1784 } } ignore_live_leader: false dest_uuid: "96d28122a9b140369b9a9dd3a2432d6a" is_pre_election: true
I20260925 14:50:05.488050 13881 leader_election.cc:398] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [CANDIDATE]: Term 3 election: Vote denied by peer a85278aa3bfe45f1be717b3a18de2e8a (127.12.96.198:35925) with higher term. Message: Invalid argument: T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f58555a88f3741e8972f9babc9bbc46a for earlier term 3. Current term is 4.
I20260925 14:50:05.489753 14563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "15f60cba26104c4b9ebb52818978c1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" is_pre_election: true
I20260925 14:50:05.489773 14562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "15f60cba26104c4b9ebb52818978c1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "a85278aa3bfe45f1be717b3a18de2e8a"
I20260925 14:50:05.489830 14563 raft_consensus.cc:2454] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15f60cba26104c4b9ebb52818978c1d3 in term 4.
I20260925 14:50:05.539216 13683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "701c21bd0bd34d0e9e56f196738cbd11" candidate_term: 3 candidate_status { last_received { term: 2 index: 1494 } } ignore_live_leader: false dest_uuid: "bee1b311890c4c16a344bbde7933c838" is_pre_election: true
I20260925 14:50:05.539419 13685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "f58555a88f3741e8972f9babc9bbc46a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "bee1b311890c4c16a344bbde7933c838"
I20260925 14:50:05.540112 13684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "f58555a88f3741e8972f9babc9bbc46a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "bee1b311890c4c16a344bbde7933c838" is_pre_election: true
I20260925 14:50:05.540253 13681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "15f60cba26104c4b9ebb52818978c1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "bee1b311890c4c16a344bbde7933c838"
I20260925 14:50:05.540365 13680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a6fe4312bf89420a80f740f43ae5b25c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1745 } } ignore_live_leader: false dest_uuid: "bee1b311890c4c16a344bbde7933c838" is_pre_election: true
I20260925 14:50:05.540474 13682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "15f60cba26104c4b9ebb52818978c1d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 1785 } } ignore_live_leader: false dest_uuid: "bee1b311890c4c16a344bbde7933c838" is_pre_election: true
I20260925 14:50:05.541195 14662 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40230 (ReqId={client: ce4246662b7945ca8edc7bdb65555c22, seq_no=1775, attempt_no=0}) took 1567 ms. Trace:
I20260925 14:50:05.541293 13359 leader_election.cc:302] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 7 responses out of 7 voters: 3 yes votes; 4 no votes. yes voters: 15f60cba26104c4b9ebb52818978c1d3, 701c21bd0bd34d0e9e56f196738cbd11, a6fe4312bf89420a80f740f43ae5b25c; no voters: 96d28122a9b140369b9a9dd3a2432d6a, a85278aa3bfe45f1be717b3a18de2e8a, bee1b311890c4c16a344bbde7933c838, f58555a88f3741e8972f9babc9bbc46a
I20260925 14:50:05.541416 14661 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40230 (ReqId={client: ce4246662b7945ca8edc7bdb65555c22, seq_no=1774, attempt_no=0}) took 1567 ms. Trace:
I20260925 14:50:05.541487 14649 raft_consensus.cc:2726] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 14:50:05.541688 13422 raft_consensus.cc:1226] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 15f60cba26104c4b9ebb52818978c1d3 [term 4 FOLLOWER]: Rejecting Update request from peer bee1b311890c4c16a344bbde7933c838 for earlier term 2. Current term is 4. Ops: []
I20260925 14:50:05.541695 14663 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40230 (ReqId={client: ce4246662b7945ca8edc7bdb65555c22, seq_no=1777, attempt_no=0}) took 1567 ms. Trace:
I20260925 14:50:05.541738 13946 raft_consensus.cc:1226] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 3 LEADER]: Rejecting Update request from peer bee1b311890c4c16a344bbde7933c838 for earlier term 2. Current term is 3. Ops: []
I20260925 14:50:05.541731 14663 rpcz_store.cc:276] 0925 14:50:03.974217 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 14:50:03.974238 (+ 21us) service_pool.cc:227] Handling call
0925 14:50:05.541691 (+1567453us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 14:50:03.974305 (+ 0us) write_op.cc:183] PREPARE: starting on tablet cdae0f54cf1e45a8b448ea0c6fb3f369
0925 14:50:03.974310 (+ 5us) write_op.cc:432] Acquiring schema lock in shared mode
0925 14:50:03.974311 (+ 1us) write_op.cc:435] Acquired schema lock
0925 14:50:03.974311 (+ 0us) tablet.cc:660] Decoding operations
0925 14:50:03.974321 (+ 10us) write_op.cc:620] Acquiring the partition lock for write op
0925 14:50:03.974322 (+ 1us) write_op.cc:641] Partition lock acquired for write op
0925 14:50:03.974323 (+ 1us) tablet.cc:683] Acquiring locks for 10 operations
0925 14:50:03.974330 (+ 7us) tablet.cc:699] Row locks acquired
0925 14:50:03.974331 (+ 1us) write_op.cc:260] PREPARE: finished
0925 14:50:03.974334 (+ 3us) write_op.cc:270] Start()
0925 14:50:03.974336 (+ 2us) write_op.cc:276] Timestamp: P: 1790347803974310 usec, L: 0
0925 14:50:03.974336 (+ 0us) op_driver.cc:331] REPLICATION: starting
0925 14:50:03.974354 (+ 18us) log.cc:842] Serialized 696 byte log entry
0925 14:50:05.540930 (+1566576us) op_driver.cc:444] REPLICATION: finished
0925 14:50:05.541614 (+ 684us) write_op.cc:301] APPLY: starting
0925 14:50:05.541616 (+ 2us) tablet.cc:1365] starting BulkCheckPresence
0925 14:50:05.541620 (+ 4us) tablet.cc:1368] finished BulkCheckPresence
0925 14:50:05.541623 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 14:50:05.541649 (+ 26us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 14:50:05.541651 (+ 2us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0925 14:50:05.541652 (+ 1us) write_op.cc:312] APPLY: finished
0925 14:50:05.541665 (+ 13us) log.cc:842] Serialized 77 byte log entry
0925 14:50:05.541671 (+ 6us) write_op.cc:489] Releasing partition, row and schema locks
0925 14:50:05.541675 (+ 4us) write_op.cc:454] Released schema lock
0925 14:50:05.541676 (+ 1us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":676,"num_ops":10,"prepare.queue_time_us":17,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":66,"replication_time_us":1566592,"thread_start_us":35,"threads_started":1}]]}
I20260925 14:50:05.541466 14661 rpcz_store.cc:276] 0925 14:50:03.973499 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 14:50:03.973658 (+ 159us) service_pool.cc:227] Handling call
0925 14:50:05.541410 (+1567752us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 14:50:03.973757 (+ 0us) write_op.cc:183] PREPARE: starting on tablet cdae0f54cf1e45a8b448ea0c6fb3f369
0925 14:50:03.973760 (+ 3us) write_op.cc:432] Acquiring schema lock in shared mode
0925 14:50:03.973760 (+ 0us) write_op.cc:435] Acquired schema lock
0925 14:50:03.973760 (+ 0us) tablet.cc:660] Decoding operations
0925 14:50:03.973768 (+ 8us) write_op.cc:620] Acquiring the partition lock for write op
0925 14:50:03.973769 (+ 1us) write_op.cc:641] Partition lock acquired for write op
0925 14:50:03.973769 (+ 0us) tablet.cc:683] Acquiring locks for 10 operations
0925 14:50:03.973774 (+ 5us) tablet.cc:699] Row locks acquired
0925 14:50:03.973775 (+ 1us) write_op.cc:260] PREPARE: finished
0925 14:50:03.973776 (+ 1us) write_op.cc:270] Start()
0925 14:50:03.973777 (+ 1us) write_op.cc:276] Timestamp: P: 1790347803973753 usec, L: 0
0925 14:50:03.973777 (+ 0us) op_driver.cc:331] REPLICATION: starting
0925 14:50:03.973787 (+ 10us) log.cc:842] Serialized 696 byte log entry
0925 14:50:05.540903 (+1567116us) op_driver.cc:444] REPLICATION: finished
0925 14:50:05.541337 (+ 434us) write_op.cc:301] APPLY: starting
0925 14:50:05.541340 (+ 3us) tablet.cc:1365] starting BulkCheckPresence
0925 14:50:05.541345 (+ 5us) tablet.cc:1368] finished BulkCheckPresence
0925 14:50:05.541347 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 14:50:05.541366 (+ 19us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 14:50:05.541369 (+ 3us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0925 14:50:05.541370 (+ 1us) write_op.cc:312] APPLY: finished
0925 14:50:05.541383 (+ 13us) log.cc:842] Serialized 77 byte log entry
0925 14:50:05.541390 (+ 7us) write_op.cc:489] Releasing partition, row and schema locks
0925 14:50:05.541395 (+ 5us) write_op.cc:454] Released schema lock
0925 14:50:05.541396 (+ 1us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":426,"num_ops":10,"prepare.queue_time_us":74,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"replication_time_us":1567124,"thread_start_us":23,"threads_started":1}]]}
I20260925 14:50:05.542091 14209 raft_consensus.cc:1226] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a6fe4312bf89420a80f740f43ae5b25c [term 4 FOLLOWER]: Rejecting Update request from peer bee1b311890c4c16a344bbde7933c838 for earlier term 2. Current term is 4. Ops: [2.1746-2.1785]
I20260925 14:50:05.542155 14663 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40230 (ReqId={client: ce4246662b7945ca8edc7bdb65555c22, seq_no=1779, attempt_no=0}) took 1567 ms. Trace:
I20260925 14:50:05.542191 14663 rpcz_store.cc:276] 0925 14:50:03.974423 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 14:50:03.974440 (+ 17us) service_pool.cc:227] Handling call
0925 14:50:05.542152 (+1567712us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 14:50:03.974710 (+ 0us) write_op.cc:183] PREPARE: starting on tablet cdae0f54cf1e45a8b448ea0c6fb3f369
0925 14:50:03.974716 (+ 6us) write_op.cc:432] Acquiring schema lock in shared mode
0925 14:50:03.974716 (+ 0us) write_op.cc:435] Acquired schema lock
0925 14:50:03.974716 (+ 0us) tablet.cc:660] Decoding operations
0925 14:50:03.974727 (+ 11us) write_op.cc:620] Acquiring the partition lock for write op
0925 14:50:03.974728 (+ 1us) write_op.cc:641] Partition lock acquired for write op
0925 14:50:03.974729 (+ 1us) tablet.cc:683] Acquiring locks for 10 operations
0925 14:50:03.974736 (+ 7us) tablet.cc:699] Row locks acquired
0925 14:50:03.974736 (+ 0us) write_op.cc:260] PREPARE: finished
0925 14:50:03.974739 (+ 3us) write_op.cc:270] Start()
0925 14:50:03.974741 (+ 2us) write_op.cc:276] Timestamp: P: 1790347803974716 usec, L: 0
0925 14:50:03.974742 (+ 1us) op_driver.cc:331] REPLICATION: starting
0925 14:50:03.974760 (+ 18us) log.cc:842] Serialized 686 byte log entry
0925 14:50:05.540968 (+1566208us) op_driver.cc:444] REPLICATION: finished
0925 14:50:05.542091 (+ 1123us) write_op.cc:301] APPLY: starting
0925 14:50:05.542093 (+ 2us) tablet.cc:1365] starting BulkCheckPresence
0925 14:50:05.542097 (+ 4us) tablet.cc:1368] finished BulkCheckPresence
0925 14:50:05.542098 (+ 1us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 14:50:05.542118 (+ 20us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 14:50:05.542121 (+ 3us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0925 14:50:05.542121 (+ 0us) write_op.cc:312] APPLY: finished
0925 14:50:05.542131 (+ 10us) log.cc:842] Serialized 77 byte log entry
0925 14:50:05.542135 (+ 4us) write_op.cc:489] Releasing partition, row and schema locks
0925 14:50:05.542140 (+ 5us) write_op.cc:454] Released schema lock
0925 14:50:05.542140 (+ 0us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1118,"num_ops":10,"prepare.queue_time_us":231,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":64,"replication_time_us":1566225,"thread_start_us":24,"threads_started":1}]]}
I20260925 14:50:05.542414 14661 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40230 (ReqId={client: ce4246662b7945ca8edc7bdb65555c22, seq_no=1781, attempt_no=0}) took 1567 ms. Trace:
I20260925 14:50:05.542448 14661 rpcz_store.cc:276] 0925 14:50:03.974462 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 14:50:03.974478 (+ 16us) service_pool.cc:227] Handling call
0925 14:50:05.542411 (+1567933us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 14:50:03.974775 (+ 0us) write_op.cc:183] PREPARE: starting on tablet cdae0f54cf1e45a8b448ea0c6fb3f369
0925 14:50:03.974779 (+ 4us) write_op.cc:432] Acquiring schema lock in shared mode
0925 14:50:03.974779 (+ 0us) write_op.cc:435] Acquired schema lock
0925 14:50:03.974779 (+ 0us) tablet.cc:660] Decoding operations
0925 14:50:03.974786 (+ 7us) write_op.cc:620] Acquiring the partition lock for write op
0925 14:50:03.974787 (+ 1us) write_op.cc:641] Partition lock acquired for write op
0925 14:50:03.974787 (+ 0us) tablet.cc:683] Acquiring locks for 10 operations
0925 14:50:03.974792 (+ 5us) tablet.cc:699] Row locks acquired
0925 14:50:03.974793 (+ 1us) write_op.cc:260] PREPARE: finished
0925 14:50:03.974795 (+ 2us) write_op.cc:270] Start()
0925 14:50:03.974796 (+ 1us) write_op.cc:276] Timestamp: P: 1790347803974771 usec, L: 0
0925 14:50:03.974796 (+ 0us) op_driver.cc:331] REPLICATION: starting
0925 14:50:03.974806 (+ 10us) log.cc:842] Serialized 696 byte log entry
0925 14:50:05.540996 (+1566190us) op_driver.cc:444] REPLICATION: finished
0925 14:50:05.542358 (+ 1362us) write_op.cc:301] APPLY: starting
0925 14:50:05.542359 (+ 1us) tablet.cc:1365] starting BulkCheckPresence
0925 14:50:05.542363 (+ 4us) tablet.cc:1368] finished BulkCheckPresence
0925 14:50:05.542364 (+ 1us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 14:50:05.542381 (+ 17us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 14:50:05.542383 (+ 2us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0925 14:50:05.542384 (+ 1us) write_op.cc:312] APPLY: finished
0925 14:50:05.542393 (+ 9us) log.cc:842] Serialized 77 byte log entry
0925 14:50:05.542397 (+ 4us) write_op.cc:489] Releasing partition, row and schema locks
0925 14:50:05.542401 (+ 4us) write_op.cc:454] Released schema lock
0925 14:50:05.542401 (+ 0us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1357,"num_ops":10,"prepare.queue_time_us":272,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":41,"replication_time_us":1566198,"spinlock_wait_cycles":9984}]]}
I20260925 14:50:05.542729 14663 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40230 (ReqId={client: ce4246662b7945ca8edc7bdb65555c22, seq_no=1780, attempt_no=0}) took 1568 ms. Trace:
I20260925 14:50:05.542771 14663 rpcz_store.cc:276] 0925 14:50:03.974451 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 14:50:03.974509 (+ 58us) service_pool.cc:227] Handling call
0925 14:50:05.542726 (+1568217us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 14:50:03.974820 (+ 0us) write_op.cc:183] PREPARE: starting on tablet cdae0f54cf1e45a8b448ea0c6fb3f369
0925 14:50:03.974823 (+ 3us) write_op.cc:432] Acquiring schema lock in shared mode
0925 14:50:03.974823 (+ 0us) write_op.cc:435] Acquired schema lock
0925 14:50:03.974823 (+ 0us) tablet.cc:660] Decoding operations
0925 14:50:03.974829 (+ 6us) write_op.cc:620] Acquiring the partition lock for write op
0925 14:50:03.974829 (+ 0us) write_op.cc:641] Partition lock acquired for write op
0925 14:50:03.974830 (+ 1us) tablet.cc:683] Acquiring locks for 10 operations
0925 14:50:03.974834 (+ 4us) tablet.cc:699] Row locks acquired
0925 14:50:03.974835 (+ 1us) write_op.cc:260] PREPARE: finished
0925 14:50:03.974836 (+ 1us) write_op.cc:270] Start()
0925 14:50:03.974837 (+ 1us) write_op.cc:276] Timestamp: P: 1790347803974813 usec, L: 0
0925 14:50:03.974837 (+ 0us) op_driver.cc:331] REPLICATION: starting
0925 14:50:03.974934 (+ 97us) log.cc:842] Serialized 696 byte log entry
0925 14:50:05.540998 (+1566064us) op_driver.cc:444] REPLICATION: finished
0925 14:50:05.542673 (+ 1675us) write_op.cc:301] APPLY: starting
0925 14:50:05.542675 (+ 2us) tablet.cc:1365] starting BulkCheckPresence
0925 14:50:05.542678 (+ 3us) tablet.cc:1368] finished BulkCheckPresence
0925 14:50:05.542680 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 14:50:05.542696 (+ 16us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 14:50:05.542699 (+ 3us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0925 14:50:05.542699 (+ 0us) write_op.cc:312] APPLY: finished
0925 14:50:05.542709 (+ 10us) log.cc:842] Serialized 77 byte log entry
0925 14:50:05.542712 (+ 3us) write_op.cc:489] Releasing partition, row and schema locks
0925 14:50:05.542715 (+ 3us) write_op.cc:454] Released schema lock
0925 14:50:05.542716 (+ 1us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1669,"num_ops":10,"prepare.queue_time_us":293,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":125,"replication_time_us":1566159,"spinlock_wait_cycles":188288}]]}
I20260925 14:50:05.542913 14563 raft_consensus.cc:1226] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 4 FOLLOWER]: Rejecting Update request from peer bee1b311890c4c16a344bbde7933c838 for earlier term 2. Current term is 4. Ops: [2.1785-2.1785]
I20260925 14:50:05.542971 14661 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40230 (ReqId={client: ce4246662b7945ca8edc7bdb65555c22, seq_no=1778, attempt_no=0}) took 1568 ms. Trace:
I20260925 14:50:05.542999 14661 rpcz_store.cc:276] 0925 14:50:03.974440 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 14:50:03.974542 (+ 102us) service_pool.cc:227] Handling call
0925 14:50:05.542969 (+1568427us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 14:50:03.974949 (+ 0us) write_op.cc:183] PREPARE: starting on tablet cdae0f54cf1e45a8b448ea0c6fb3f369
0925 14:50:03.974952 (+ 3us) write_op.cc:432] Acquiring schema lock in shared mode
0925 14:50:03.974952 (+ 0us) write_op.cc:435] Acquired schema lock
0925 14:50:03.974952 (+ 0us) tablet.cc:660] Decoding operations
0925 14:50:03.974960 (+ 8us) write_op.cc:620] Acquiring the partition lock for write op
0925 14:50:03.974961 (+ 1us) write_op.cc:641] Partition lock acquired for write op
0925 14:50:03.974961 (+ 0us) tablet.cc:683] Acquiring locks for 10 operations
0925 14:50:03.974967 (+ 6us) tablet.cc:699] Row locks acquired
0925 14:50:03.974967 (+ 0us) write_op.cc:260] PREPARE: finished
0925 14:50:03.974969 (+ 2us) write_op.cc:270] Start()
0925 14:50:03.974970 (+ 1us) write_op.cc:276] Timestamp: P: 1790347803974946 usec, L: 0
0925 14:50:03.974971 (+ 1us) op_driver.cc:331] REPLICATION: starting
0925 14:50:03.974979 (+ 8us) log.cc:842] Serialized 696 byte log entry
0925 14:50:05.541000 (+1566021us) op_driver.cc:444] REPLICATION: finished
0925 14:50:05.542915 (+ 1915us) write_op.cc:301] APPLY: starting
0925 14:50:05.542916 (+ 1us) tablet.cc:1365] starting BulkCheckPresence
0925 14:50:05.542920 (+ 4us) tablet.cc:1368] finished BulkCheckPresence
0925 14:50:05.542921 (+ 1us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 14:50:05.542943 (+ 22us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 14:50:05.542945 (+ 2us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0925 14:50:05.542946 (+ 1us) write_op.cc:312] APPLY: finished
0925 14:50:05.542954 (+ 8us) log.cc:842] Serialized 77 byte log entry
0925 14:50:05.542957 (+ 3us) write_op.cc:489] Releasing partition, row and schema locks
0925 14:50:05.542960 (+ 3us) write_op.cc:454] Released schema lock
0925 14:50:05.542960 (+ 0us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1907,"num_ops":10,"prepare.queue_time_us":388,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"replication_time_us":1566028,"spinlock_wait_cycles":1920}]]}
I20260925 14:50:05.543126 14485 consensus_queue.cc:1046] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 }, Status: INVALID_TERM, Last received: 2.1785, Next index: 1786, Last known committed idx: 1777, Time since last communication: 0.000s
I20260925 14:50:05.543205 14485 consensus_queue.cc:1225] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [LEADER]: Peer f58555a88f3741e8972f9babc9bbc46a log is divergent from this leader: its last log entry 3.1786 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1777
I20260925 14:50:05.543231 14485 consensus_queue.cc:1046] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 }, Status: INVALID_TERM, Last received: 2.1785, Next index: 1786, Last known committed idx: 1777, Time since last communication: 0.000s
I20260925 14:50:05.543269 14485 raft_consensus.cc:3032] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 14:50:05.543288 14485 raft_consensus.cc:729] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bee1b311890c4c16a344bbde7933c838, State: Running, Role: LEADER
I20260925 14:50:05.543332 14485 consensus_queue.cc:260] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1784, Committed index: 1784, Last appended: 2.1785, Last appended by leader: 1785, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:05.543433 14485 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [term 2 FOLLOWER]: Advancing to term 3
I20260925 14:50:05.544399 13552 raft_consensus.cc:1226] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 4 FOLLOWER]: Rejecting Update request from peer bee1b311890c4c16a344bbde7933c838 for earlier term 2. Current term is 4. Ops: [2.1495-2.1785]
W20260925 14:50:05.544831 13644 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40230: Illegal state: replica bee1b311890c4c16a344bbde7933c838 is not leader of this config: current role FOLLOWER
W20260925 14:50:05.545089 13638 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40230: Illegal state: replica bee1b311890c4c16a344bbde7933c838 is not leader of this config: current role FOLLOWER
W20260925 14:50:05.545209 13642 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40230: Illegal state: replica bee1b311890c4c16a344bbde7933c838 is not leader of this config: current role FOLLOWER
W20260925 14:50:05.545300 13641 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40230: Illegal state: replica bee1b311890c4c16a344bbde7933c838 is not leader of this config: current role FOLLOWER
I20260925 14:50:05.541275 14662 rpcz_store.cc:276] 0925 14:50:03.973538 (+ 0us) service_pool.cc:170] Inserting onto call queue
0925 14:50:03.973625 (+ 87us) service_pool.cc:227] Handling call
0925 14:50:05.541189 (+1567564us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 14:50:03.973712 (+ 0us) write_op.cc:183] PREPARE: starting on tablet cdae0f54cf1e45a8b448ea0c6fb3f369
0925 14:50:03.973716 (+ 4us) write_op.cc:432] Acquiring schema lock in shared mode
0925 14:50:03.973716 (+ 0us) write_op.cc:435] Acquired schema lock
0925 14:50:03.973717 (+ 1us) tablet.cc:660] Decoding operations
0925 14:50:03.973724 (+ 7us) write_op.cc:620] Acquiring the partition lock for write op
0925 14:50:03.973724 (+ 0us) write_op.cc:641] Partition lock acquired for write op
0925 14:50:03.973725 (+ 1us) tablet.cc:683] Acquiring locks for 10 operations
0925 14:50:03.973730 (+ 5us) tablet.cc:699] Row locks acquired
0925 14:50:03.973730 (+ 0us) write_op.cc:260] PREPARE: finished
0925 14:50:03.973732 (+ 2us) write_op.cc:270] Start()
0925 14:50:03.973734 (+ 2us) write_op.cc:276] Timestamp: P: 1790347803973709 usec, L: 0
0925 14:50:03.973734 (+ 0us) op_driver.cc:331] REPLICATION: starting
0925 14:50:03.973743 (+ 9us) log.cc:842] Serialized 686 byte log entry
0925 14:50:05.540843 (+1567100us) op_driver.cc:444] REPLICATION: finished
0925 14:50:05.540998 (+ 155us) write_op.cc:301] APPLY: starting
0925 14:50:05.541003 (+ 5us) tablet.cc:1365] starting BulkCheckPresence
0925 14:50:05.541009 (+ 6us) tablet.cc:1368] finished BulkCheckPresence
0925 14:50:05.541012 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 14:50:05.541047 (+ 35us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 14:50:05.541052 (+ 5us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0925 14:50:05.541052 (+ 0us) write_op.cc:312] APPLY: finished
0925 14:50:05.541073 (+ 21us) log.cc:842] Serialized 77 byte log entry
0925 14:50:05.541163 (+ 90us) write_op.cc:489] Releasing partition, row and schema locks
0925 14:50:05.541168 (+ 5us) write_op.cc:454] Released schema lock
0925 14:50:05.541169 (+ 1us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":142,"num_ops":10,"prepare.queue_time_us":60,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":42,"replication_time_us":1567105,"spinlock_wait_cycles":12672,"thread_start_us":128,"threads_started":2,"wal-append.queue_time_us":2359}]]}
W20260925 14:50:05.545544 13643 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40230: Illegal state: replica bee1b311890c4c16a344bbde7933c838 is not leader of this config: current role FOLLOWER
W20260925 14:50:05.545867 13643 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40230: Illegal state: replica bee1b311890c4c16a344bbde7933c838 is not leader of this config: current role FOLLOWER
W20260925 14:50:05.546195 13643 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40230: Illegal state: replica bee1b311890c4c16a344bbde7933c838 is not leader of this config: current role FOLLOWER
I20260925 14:50:05.548178 13683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdae0f54cf1e45a8b448ea0c6fb3f369" candidate_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1784 } } ignore_live_leader: false dest_uuid: "bee1b311890c4c16a344bbde7933c838" is_pre_election: true
I20260925 14:50:05.548285 13683 raft_consensus.cc:2396] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a85278aa3bfe45f1be717b3a18de2e8a for term 3 because replica has last-logged OpId of term: 2 index: 1785, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1784.
I20260925 14:50:05.562381 13815 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a [term 2 FOLLOWER]: Advancing to term 3
I20260925 14:50:05.562512 13683 raft_consensus.cc:1261] T cdae0f54cf1e45a8b448ea0c6fb3f369 P bee1b311890c4c16a344bbde7933c838 [term 3 FOLLOWER]: Refusing update from remote peer f58555a88f3741e8972f9babc9bbc46a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1785. Preceding OpId from leader: term: 3 index: 1787. (index mismatch)
I20260925 14:50:05.562533 13552 raft_consensus.cc:1226] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 701c21bd0bd34d0e9e56f196738cbd11 [term 4 FOLLOWER]: Rejecting Update request from peer f58555a88f3741e8972f9babc9bbc46a for earlier term 3. Current term is 4. Ops: []
I20260925 14:50:05.562697 14647 consensus_queue.cc:1035] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1786, Last known committed idx: 1784, Time since last communication: 0.000s
I20260925 14:50:05.562849 14647 consensus_queue.cc:1046] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1786, Last known committed idx: 1489, Time since last communication: 0.000s
I20260925 14:50:05.562922 14647 raft_consensus.cc:3032] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 3 LEADER]: Stepping down as leader of term 3
I20260925 14:50:05.562942 14647 raft_consensus.cc:729] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f58555a88f3741e8972f9babc9bbc46a, State: Running, Role: LEADER
I20260925 14:50:05.562984 14647 consensus_queue.cc:260] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1777, Committed index: 1777, Last appended: 3.1787, Last appended by leader: 1787, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee1b311890c4c16a344bbde7933c838" member_type: VOTER last_known_addr { host: "127.12.96.195" port: 44787 } } peers { permanent_uuid: "f58555a88f3741e8972f9babc9bbc46a" member_type: VOTER last_known_addr { host: "127.12.96.197" port: 36415 } } peers { permanent_uuid: "15f60cba26104c4b9ebb52818978c1d3" member_type: VOTER last_known_addr { host: "127.12.96.193" port: 34571 } } peers { permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 } } peers { permanent_uuid: "a6fe4312bf89420a80f740f43ae5b25c" member_type: VOTER last_known_addr { host: "127.12.96.199" port: 43631 } } peers { permanent_uuid: "701c21bd0bd34d0e9e56f196738cbd11" member_type: VOTER last_known_addr { host: "127.12.96.194" port: 37593 } } peers { permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 } }
I20260925 14:50:05.563237 13815 raft_consensus.cc:1261] T cdae0f54cf1e45a8b448ea0c6fb3f369 P 96d28122a9b140369b9a9dd3a2432d6a [term 3 FOLLOWER]: Refusing update from remote peer f58555a88f3741e8972f9babc9bbc46a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1785. Preceding OpId from leader: term: 3 index: 1787. (index mismatch)
I20260925 14:50:05.563359 14563 raft_consensus.cc:1226] T cdae0f54cf1e45a8b448ea0c6fb3f369 P a85278aa3bfe45f1be717b3a18de2e8a [term 4 FOLLOWER]: Rejecting Update request from peer f58555a88f3741e8972f9babc9bbc46a for earlier term 3. Current term is 4. Ops: []
I20260925 14:50:05.563499 14653 consensus_queue.cc:1035] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "96d28122a9b140369b9a9dd3a2432d6a" member_type: VOTER last_known_addr { host: "127.12.96.196" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1786, Last known committed idx: 1784, Time since last communication: 0.000s
I20260925 14:50:05.563573 14653 consensus_queue.cc:1046] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a85278aa3bfe45f1be717b3a18de2e8a" member_type: VOTER last_known_addr { host: "127.12.96.198" port: 35925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1786, Last known committed idx: 1776, Time since last communication: 0.000s
I20260925 14:50:05.563740 14647 raft_consensus.cc:3037] T cdae0f54cf1e45a8b448ea0c6fb3f369 P f58555a88f3741e8972f9babc9bbc46a [term 3 FOLLOWER]: Advancing to term 4
W20260925 14:50:05.564309 14673 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:37622: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.002s ago.
W20260925 14:50:05.564532 14673 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:37622: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.002s ago.
W20260925 14:50:05.564692 14673 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:37622: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.002s ago.
W20260925 14:50:05.564810 14673 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:37622: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.002s ago.
W20260925 14:50:05.564911 14673 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:37622: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.003s ago.
W20260925 14:50:05.565037 14673 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:37622: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.003s ago.
W20260925 14:50:05.571846 13383 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:39298: Illegal state: replica 15f60cba26104c4b9ebb52818978c1d3 is not leader of this config: current role FOLLOWER
W20260925 14:50:05.571893 13380 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:39298: Illegal state: replica 15f60cba26104c4b9ebb52818978c1d3 is not leader of this config: current role FOLLOWER
W20260925 14:50:05.572084 13379 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:39298: Illegal state: replica 15f60cba26104c4b9ebb52818978c1d3 is not leader of this config: current role FOLLOWER
W20260925 14:50:05.572220 13378 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:39298: Illegal state: replica 15f60cba26104c4b9ebb52818978c1d3 is not leader of this config: current role FOLLOWER
W20260925 14:50:05.571846 13382 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:39298: Illegal state: replica 15f60cba26104c4b9ebb52818978c1d3 is not leader of this config: current role FOLLOWER
W20260925 14:50:05.571846 13381 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:39298: Illegal state: replica 15f60cba26104c4b9ebb52818978c1d3 is not leader of this config: current role FOLLOWER
W20260925 14:50:05.582300 14168 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53644: Illegal state: replica a6fe4312bf89420a80f740f43ae5b25c is not leader of this config: current role FOLLOWER
W20260925 14:50:05.582297 14169 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53644: Illegal state: replica a6fe4312bf89420a80f740f43ae5b25c is not leader of this config: current role FOLLOWER
W20260925 14:50:05.582804 14167 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53644: Illegal state: replica a6fe4312bf89420a80f740f43ae5b25c is not leader of this config: current role FOLLOWER
W20260925 14:50:05.582950 14166 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53644: Illegal state: replica a6fe4312bf89420a80f740f43ae5b25c is not leader of this config: current role FOLLOWER
W20260925 14:50:05.583060 14165 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53644: Illegal state: replica a6fe4312bf89420a80f740f43ae5b25c is not leader of this config: current role FOLLOWER
W20260925 14:50:05.583161 14164 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53644: Illegal state: replica a6fe4312bf89420a80f740f43ae5b25c is not leader of this config: current role FOLLOWER
W20260925 14:50:05.590852 13511 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:41014: Illegal state: replica 701c21bd0bd34d0e9e56f196738cbd11 is not leader of this config: current role FOLLOWER
W20260925 14:50:05.590809 13512 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:41014: Illegal state: replica 701c21bd0bd34d0e9e56f196738cbd11 is not leader of this config: current role FOLLOWER
W20260925 14:50:05.590806 13514 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:41014: Illegal state: replica 701c21bd0bd34d0e9e56f196738cbd11 is not leader of this config: current role FOLLOWER
W20260925 14:50:05.590807 13513 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:41014: Illegal state: replica 701c21bd0bd34d0e9e56f196738cbd11 is not leader of this config: current role FOLLOWER
W20260925 14:50:05.591290 13513 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:41014: Illegal state: replica 701c21bd0bd34d0e9e56f196738cbd11 is not leader of this config: current role FOLLOWER
W20260925 14:50:05.592219 13513 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:41014: Illegal state: replica 701c21bd0bd34d0e9e56f196738cbd11 is not leader of this config: current role FOLLOWER
F20260925 14:50:05.592248 12675 raft_consensus-itest.cc:398] Check failed: _s.ok() Bad status: Not found: leader replica not found
*** Check failure stack trace: ***
*** Aborted at 1790347805 (unix time) try "date -d @1790347805" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800003183) received by PID 12675 (TID 0x7fdd7df61440) from PID 12675; stack trace: ***
@ 0x7fdd81137a46 google::(anonymous namespace)::FailureSignalHandler() at ??:0
@ 0x7fdd82f01980 (unknown) at ??:0
@ 0x7fdd7ec4fe87 gsignal at ??:0
@ 0x7fdd7ec517f1 abort at ??:0
@ 0x7fdd811299ad google::LogMessage::Fail() at ??:0
@ 0x7fdd8112c88a google::LogMessage::SendToLog() at ??:0
W20260925 14:50:05.599951 13773 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:59940: Illegal state: replica 96d28122a9b140369b9a9dd3a2432d6a is not leader of this config: current role FOLLOWER
W20260925 14:50:05.599898 13774 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:59940: Illegal state: replica 96d28122a9b140369b9a9dd3a2432d6a is not leader of this config: current role FOLLOWER
W20260925 14:50:05.599900 13776 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:59940: Illegal state: replica 96d28122a9b140369b9a9dd3a2432d6a is not leader of this config: current role FOLLOWER
@ 0x7fdd811294de google::LogMessage::Flush() at ??:0
W20260925 14:50:05.599898 13775 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:59940: Illegal state: replica 96d28122a9b140369b9a9dd3a2432d6a is not leader of this config: current role FOLLOWER
W20260925 14:50:05.600360 13776 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:59940: Illegal state: replica 96d28122a9b140369b9a9dd3a2432d6a is not leader of this config: current role FOLLOWER
W20260925 14:50:05.600419 13774 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:59940: Illegal state: replica 96d28122a9b140369b9a9dd3a2432d6a is not leader of this config: current role FOLLOWER
@ 0x7fdd8112aa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x43b95e kudu::tserver::RaftConsensusITest::StopOrKillLeaderAndElectNewOne() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/raft_consensus-itest.cc:435 (discriminator 21)
@ 0x446ccf kudu::tserver::RaftConsensusITest_MultiThreadedInsertWithFailovers_Test::TestBody() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/raft_consensus-itest.cc:1060
@ 0x7fdd82543bfe testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
@ 0x7fdd825385db testing::Test::Run() at ??:0
@ 0x7fdd82538795 testing::TestInfo::Run() at ??:0
@ 0x7fdd82538cdf testing::TestSuite::Run() at ??:0
@ 0x7fdd8253929f testing::internal::UnitTestImpl::RunAllTests() at ??:0
@ 0x7fdd8254413e testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
W20260925 14:50:05.607514 13906 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:37622: Illegal state: replica f58555a88f3741e8972f9babc9bbc46a is not leader of this config: current role FOLLOWER
W20260925 14:50:05.607514 13903 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:37622: Illegal state: replica f58555a88f3741e8972f9babc9bbc46a is not leader of this config: current role FOLLOWER
@ 0x7fdd8253883d testing::UnitTest::Run() at ??:0
@ 0x438cba main at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_main.cc:110
@ 0x7fdd7ec32c87 __libc_start_main at ??:0
@ 0x438ef2 (unknown) at ??:?